Server status popping up after leaving the map

I have the exact same problem also using an Xbox One Controller with Windows Xbox wireless adapter (the old adapter just in case it’s relevant). 
Even with default button bindings the problem is occurring.
 

When I hit the back button the map appears as it should.

I press B to close the map, it closes.  

I now see the Server status window with the players list. From the button hints below the window there is no binding for the back action and so the only way of escaping this frustrating unwanted window is to press A on one of the players, to then see another pop up that can be closed by pressing other buttons.

Incredibly frustrating, any ideas?

 

Okay sorry, waaaaay too late on this one, but I have the same issue all the time, I have the same issue all the time but it always happens when I open my steam friends tab to invite someone. It’s an extremely annoying glitch but if you press shift tab with either your map open or the player list open that usually seems to unglitch it in my expirence. Hope this helps!!!