alt Hacker News LLMs are notoriously non-deterministic, and even at temperature zero you still can't predict exactly where the weights will take you next.
You can 100% predict where the weights “will take you” given a set of inputs.
Replies
> You can 100% predict where the weights “will take you” given a set of inputs.
Do you mean reproduce?
Sorry it's just if you are saying what your statement implying then either the model is very simple, or you've figured out something incredible
By "can't predict exactly where the weights will take you next" I meant with your brain. The blind chess analogy suggests you can predict, using your own thought process, the exact output of a prompt.
I think when people say non-deterministic what they mean is closer to chaotic, like https://en.wikipedia.org/wiki/Chaos_theory as in very small changes in conditions can produce completely different output making predictions difficult
Can you provide steps to reproduce so I can see one of these deterministic LLMs running myself? API based or local models.
Could you give some examples?
You should publish, likely a Nobel price or Turing award waiting, and generational wealth at some tech giant.
Floating point matrix calculations are non-deterministic. You need to invent new hardware, that doesn't use floating point math, first. [0]
[0] https://arxiv.org/html/2506.09501