Lobby refresh issue

JJ209th

My friends and I play together pretty often, and on occasion it will desync our lobbies so only some of us will enter a match when we all ready up, some of us will not appear on each other's screens, etc. It's also impossible to tell without asking if everyone's readied up because it only gives us the error message sometimes. We end up having to restart our games and connect to the servers again almost every single match.