Disconnect every time I try to enter caves on friends server

I play on PS4.  When I first bought the game approximately 5 months ago, I was able to enter the caves on the first server my friend and I played on.  Then after one of the updates, every game we play I disconnect when trying to enter the caves.  I can enter the caves no problem on my own servers and can join with no problem in random servers found in the server list.  My friend also disconnects whenever he tries to enter the caves on my server.