The White House is also the name of a building.

News sources have been using both building names (and several more I can think of off the top of my head) as short hand for the people who work inside of them for my entire life.