I'm not saying this is what's happening, but I'd like to point out something relevant that I think most people in your situation never think of...
Perhaps they are well aware that they will arrive at the destination at the same time as slow people HOWEVER they have much more stationary time...