logoalt Hacker News

WithinReason • yesterday at 5:22 PM • 2 replies • view on HN

Apparently it's news to some people. It also helps combat the "LLMs ArE nOt DeTeRmInIsTiC" complaints.


Replies

recursive • yesterday at 5:39 PM

Doesn't help much

rvz • yesterday at 5:35 PM

> It also helps combat the "LLMs ArE nOt DeTeRmInIsTiC" complaints.

Reality says otherwise, especially from those who run LLMs in production at a large scale. Hacks such as baking in the weights with tiny experiments doesn't disprove anything.

The same LLM boosters also continue to repeat one of the biggest misconceptions: "sEt TeMperaTurE tO zERo tO aChiEvE fUlL dEterMinIsm."

➕ show 1 reply