Before she dies or right after she died most sounds disappeared. Getting hit was still audible as well as the weapon swing. Exiting the ant tunnels up to the surface didn't fix it. Restarting the game fixed it.
No idea. Perhaps fight queen multiple times until sound dies (excluding armor hit and weapon swing sounds).