>Different prompts might have different probabilities of successful generation, so refinement could be possible even for stochastic generation.
Yes, but that requires a formal specification of what counts as "success".
In my view, LLM based programming has to become more structured. There has to be a clear distinction between the human written specification and the LLM generated code.
If LLMs are a high level programming language, it has to be clear what the source code is and what the object code is.
I don't think framing LLMs as a "new programming language" is correct. I was addressing the point about randomness.
A natural-language specification is not source code. In most cases it's an underspecified draft that needs refinement.