That's not true. https://pmc.ncbi.nlm.nih.gov/articles/PMC2719451/ places the figure experiencing side effects at 40%, with 25% reporting those effects as serious. It's also telling that only just under half of those experiencing side effects ever reported those side effects to their providers - likely contributing to doctors getting a skewed perception of the real adverse effects risk.

What's missing is also follow up - for some those effects don't resolve after stopping the drug.