Olson's Theory of Collective action explains why this isn't true.

Concentrated interests can defeat popular movements. It fits the facts very neatly.

https://en.wikipedia.org/wiki/Collective_action_theory