Except I proposed a solution, which you ignored (I'm assuming here that I'm your "opposing side".)

Also, there are a significant number of these sorts of arguments in high-level sports, probably precisely because these "0.1%" cases are exactly the ones that result in exceptional ability relative to norms. It's also curious that there is such obsession about naturally occurring genetic outliers with respect to females or gender but absolute silence about naturally occurring genetic outliers among men unrelated to gender. And surprise surprise the top athletes often have such outlier genetics!

If you're drawing a distinction between natural genetic difference related to only gender and no other factors then sadly it's exactly a culture war, not a war based in science or fairness.