"To someone who never did anything like this themselves the result might seem fantastic ..."
I've been "doing this" for over 30 years now and I consider these LLM results to be fantastic.
If one has a deep, conceptual understanding of tools, systems and protocols and if one has the ability to carefully provide careful, concise specifications, these LLM tools are like being granted superpowers.
In fact ...
My next project upon which to bring LLM tools to bear is a fully local, solar-powered, self-hosted LLM toolchain.
Not only do I intend to never work without these tools again, I intend to do so without the ongoing environmental externalities that they produce.
Umm, hate to break it to you, but by the time you load up an open weights model, the environmental externality has already happened
But you do plan on continuing to work, not have the AI bootstrap itself into a machine god and do all possible work for humanity instead.
> If one has a deep, conceptual understanding of tools, systems and protocols and if one has the ability to carefully provide careful, concise specifications
Most people already don't have the ability to do this and their use of LLMs atrophies the little they had. "AI natives" will be completely doomed.