There isn't really any clinical evidence for CO2 levels impacting stuff beyond so called "sleep efficiency," where the effect is small (above 1000 ppm is 5% reduction in sleep efficiency) and it has the counterintuitive effect that less efficient sleep is sleeping longer, which is usually what people want. That said, placebo effects are still real.
It might be that poor ventilation gives me headaches for other reasons, and CO2 concentration is just a useful proxy that's easy to measure. The evidence seems to support this idea, whereas like you said the evidence for CO2 in isolation is pretty questionable.
If nothing else, at least a well-ventilated room expels my farts and other airborne waste products.
And people don't want to sleep longer, they want to feel well-rested. So I think higher sleep efficiency is better.
https://newscenter.lbl.gov/2012/10/17/elevated-indoor-carbon...
You are wrong about the impact of moderately high CO2 levels.