Backpack Inventory Won't Close

Sometimes when I need to switch bags of any kind or remove my bag, my backpack inventory is still there and covers the inventories of my other bags. It remains there even when I have nothing on. I've tried to put my backpack on again and close it but it just makes 2 screens. The over lapping inventory still works and is connected to my backpack it just doesn't go away no matter what I do in game, even if I die.

The only way to fix it is reboot my game over and over. I've tried to remove all mods to see if that was the problem, however, the bug still persisted.