alt Hacker NewsLimitations of AI are a thing; but one rhetorical point keeps coming up (I don't think it's just you) and confusing me:
> I hope you can see the stupidity here if you expect to see any deterministic results at all.
Are you expecting humans to be deterministic in the code they produce?
Replies
By not reviewing, reading, or understanding the code generated by agentic LLMs the output is effectively like a compiler. However, a compiler has deterministic behaviour that can be repeated and verified.
The behaviour/output of an LLM is not like that. Ask an LLM to create a dashboard to show games by genre and it will generate different results with each run, and each model/model version produces wildly different results.
The difference is that with llms you have multiple levels of nondeterminism compounding each other
I've seen LLMs do something correct 98% of the time then randomly do something crazy that a human would never do because we have continual learning
As humans we don't have our memory reset multiple times per day
Someone who knows that 1 + 1 = 2 will not decide that it's suddenly 3 unless we start accounting for health problems. Making mistakes is not the same as non-deterministic.