Extremely intense lag even when out of the moon storm

Recently on a world with some others, I tend to experience really strange lag that happens after i'm in the moon storm for maybe a period of time? Everytime I move, or my camera rotates, my FPS goes down, if I constantly rotate my camera and move, I can consistently go down to 30-40 FPS from my usual 60 FPS. I'd guess this is something to do with the moon storms shaders.

I'm not exactly sure how to reproduce this, I tried reproducing in another world but I couldn't seem to get it to happen. I guess stay in the moon storm for a long while and then walk out of it?