steam deck Game defaulting to Xbox Input

[Kleindom]

While playing DST on my Steam Deck in the past, I was able to get it to use KB+M controls by setting the compatibility to ‘Steam Linux Runtime’. However the game has started to always default to the Xbox Input when opening the game or when joining a world. This prevents me from picking a character as my controls are set for KB+M. 
 

Following others suggestions, I also tried running the game from desktop mode, as well as big picture. Both of these resulted in the same behavior.

This is all very disappointing to me as my setup for the game was working before and in my opinion was significantly better than the controller layout(I seriously hate the combat system of controller). 
 

Does anyone have any suggestions to fix this issue? Klei please let me use my controls. Defaulting to Xbox input is ridiculous when I have no Xbox controls enabled.