>The world has plenty of barren, desert areas
Often (but not always) these areas are actually degraded by human influence.In these cases, we should regenerate the ecosystems we destroyed, not treat it as "free" surface area that doesn't matter just because we damaged it.
No sane Antique Shop has a "you break it, it's now yours to do whatever you like" policy. I wonder why? :)
> you break it, it's now yours to do whatever you like
I mean, you break it, then you pay for it/deal with the consequences, then the broken pieces are yours to do whatever you like with. That is generally how it works.
I don't think leaving the land as-is is going to be better than putting solar panels on it. In fact, is seems like solar panels might be better than leaving the land alone: https://www.ecoportal.net/en/sahara-solar-panels-double-sahe...