Non-host stuck on connecting screen when entering caves

Whenever non-host players enter caves they get stuck on an infinite connecting screen even when leaving and trying to rejoin essentially softlocking them out of the world entirely