It's actually quite easy. Whoever isn't in the bunker is the outgroup. You only needed to tell people apart when you needed some meatware to man the factories and work the fields.

Militaries can side with the crowd, or more likely decide to keep the power for themselves.