logoalt Hacker News

bowsamic • today at 8:09 AM • 0 replies • view on HN

A theoretically perfect next token prediction machine is just an LLM with a temperature of 0, which performs worse than one with a non-zero temperature (i.e. imperfection)

The "prediction" has nothing to do with predicting the future, it just means choosing the most likely next token for existing human text