It is arguably one of the most important buildings and is not in the list of items you can craft with the Key to the City item, when its crafting tab pops up.
Steps to Reproduce
Start a new game, no mods, default everything. Get Key to the City and look through its crafting tab.
This issue has not been confirmed by a developer yet.