There is currently no way to activate the in game menu using the mouse. The entire rest of the game can be played mouse only.
There should be a UI button that a user can click. In order to exit the game right now you need to press ESC on the keyboard.
Start a new game and try to exit to desktop using mouse only