I always recommend this video, which covers many of the concepts above:
3 other things to consider:
Mirror isn't that great, Make sure it's not doing dumb stuff, make sure you're using the right transport, etc.
You don't need to throw away out of order messages, only those that arrive too late to be useful or those which are superceded by other messages.
You're always going to get some message loss, so on one hand you do need to actively mitigate against it with redundantly sent information and state interpolation to cover ‘gaps’, but on the other hand you want to be careful not to let these hide bugs.
Damn…
I ended up throwing away commands that arrived too late and that helped significantly. The performance is way better now and there is not stuttering
