Chester disappears after jumping in wormhole

As the title suggests, Chester would disappear after I jump into and exit a wormhole. The celestial orb inside Chester would still be in there showing on the map but if I approach the orb icon as I see it on the map, the icon disappears as my character view frame reaches the orb (inside Chester). Disconnecting and reconnecting will make Chester reappear, but the bug will still occur when using wormholes. Just a note, I have the eyebone in my inventory the whole time and the Chester I had is the ice variant of Chester, though I do not think this could be part of the bug.