logoalt Hacker News

zorked • yesterday at 10:57 AM • 1 reply • view on HN

It's not deterministic due to implementation details in floating point numbers and order of execution.

If you ran an LLM with infinite precision and guaranteed order of execution, it would be deterministic.

(I think determinism is overrated. Being deterministic does not make LLMs more reliable or correct.)


Replies

jiggawatts • yesterday at 11:15 PM

Finite precision would work fine.

Non-determinism is injected, on purpose.