logoalt Hacker News

sarchertechtoday at 3:55 AM0 repliesview on HN

The difference is that what those languages compile to is much much more stable than what is produced by running a spec through an LLM.

Python or a library might change the implementation of a sorting algorithm once in a few years. An LLM is likely to do it every time you regenerate the code.

It’s not just a matter of non-determinism either, but about how chaotic LLMs are. Compilers can produce different machine code with slightly different inputs, but it’s nothing compared to how wildly different LLM output is with very small differences in input. Adding a single word to your spec file can cause the final code to be unrecognizably different.