Glai,
Your experience makes sense, both in theory and from my own.
RIDING ON A BEAM OF SOUND
From the stylus's POV, a higher groove velocity is no different than an increase in transient velocity. If we sit inside the stylus and look outward, we cannot tell whether any particular curve we're being asked to negotiate is a gradual curve moving past us at high speed or a sharp curve moving past us at low speed. The relative effect on us is the same: we're being displaced a certain distance over a certain time span.
A fast transient is harder for our stylus to track accurately than a slow transient. By analogy, consider a car moving over a bumpy road. A car moving at 45 mph will be more likely to lose adhesion than one moving at 33mph.
To the extent any lateral bias ("skating force") exists, our stylus will require more anti-bias ("anti-skating") to track fast transients accurately compared to slow transients. Therefore, higher groove velocities will tend to require higher anti-skating compensation.
EXPERIENCE
Before my own cartridges relax enough to let me use zero A/S on all records, they go through a phase where I need TINY but VARYING amounts of A/S to track a FEW challenging passages. During this phase, the precise amount of A/S needed varies by LP and even by individual track. (In theory, it actually varies by individual transient.) The last passages to need a trace of A/S are very dynamic transients moving at 45rpm.
NOTE
The above is true independent of whether or not a higher groove velocity increases skating force, which is a matter of debate between theoretical types.