alt Hacker NewsA temperature of 0 doesn’t result in the same responses every time, in part due to floating-point precision and in part to to lack of batch invariance [1]
[1] https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
A temperature of 0 doesn’t result in the same responses every time, in part due to floating-point precision and in part to to lack of batch invariance [1]
[1] https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
Thank you for this, this was a really interesting read about batch invariance, something I didn't even know about.