not good. (but also not a terrible problem) probably a poor cart/arm combination.
For a simple cheap fix, try a bit of thin cardboard between the headshell and cart. Cut the card to be the same as the cart body top.
this may or may not work but it is a really nearly free attempt to decouple that particular combo.
And tighten the cart only snug, not really tight.
If it works some... then you can try a bit of other stuff to see if you can find a thin flat product which will decouple the cart arm better. a bit of soft vinyl, a bit of rubber... an "O" ring, thin but about the diameter of the top of cart...
Even stuff like 'Blue Tack"a tiny bit IN the underside of the headshell. (but that is less likely to work IMO.)