logoalt Hacker News

mixdupyesterday at 3:56 PM1 replyview on HN

LLMs are non-deterministic, so feeding that session back in possibly will get you a different output. Also, models change over time so you may not necessarily be able to run the session against the same model again

The whole point of the source code it generates is to have the artifact. Maybe this is somewhat useful if you need to train people how to use AI, but at the end of the day the generated code is the thing that matters. If you keep other notes/documentation from meetings and design sessions, however you keep that is probably where this should go, too?


Replies

angry_octetyesterday at 4:13 PM

They are completely deterministic? We introduce pseudo-randomness to assist with exploring the solution space.

The fact that models change is a great reason to be able to re-run a previous model and maintain revision control and repeatability.

The source code artifact is not really the point. Not anymore.