Who said psychological harm doesn't exist? It just isn't a form of violence, that's all.
It is important not to conflate the two concepts, because violence is widely criminalized and psychological harm is highly subjective. The immediate implication of bundling these completely disparate concepts is that somebody will have to arbitrate which verbal expressions constitute violent crime. This is not conjecture, activist groups have already regulated speech in several countries on the premise that words are violence.
The whole idea of "X is not being taken seriously but Y is, so I will start calling X Y instead, and anyone who corrects me tries to downplay X" is insane to me.