Why the difference changes the outcome
A route with 20 milliseconds of delay that stays at 20 can feel easier to live with than a route that bounces between 5 and 50. The average may look similar on paper. The experience is not.
That is why clean routing keeps showing up in discussions about execution quality. The trader cares less about a spec and more about whether the session behaves in a way they can trust.
How to think about it
Latency tells you how long the path takes. Jitter tells you whether the path is calm. If the market is fast, the calm path usually feels better than the path with a slightly better average and a much worse wobble.
That is the practical answer. You are not chasing a number for its own sake. You are trying to make the network less distracting when the market is already doing enough.