Caves crashing on first entry

I was playing on a friends only server on Series X with another local player. When he went down into the caves for the first time, it got stuck on the loading screen. I was going to follow him anyway, so I entered as well. We both sat for quite some time before an error messaged tried to display itself in the middle of the screen, but only I could see it on my side. His was still the loading background. I force quit the game and reentered the next time we played without issues.

Not sure how to attach logs form the console.