Connection Error when connecting to survivor match and custom match with friends

Twistedsorrow33

Whenever I play the game with my friends, we spent 3/4 of the time fighting with the stupid server. For the host, it shows maybe one or two people, but then the last two aren't visible. To the 'invisible' couple, they see themselves being in the pregame screen and everything seems fine, until they suddenly get a connection error notice. They can only join once they've completely restarted their games, and sometimes they have to restart two or three times in a row for it to work.