Your personal experience does not line up with the empirical evidence at all.
Some people are (much) smarter than others. It sucks, but that's life.