alt Hacker News> The entire premise on whether it is a bubble depends on if LLMs can be more than a next token prediction machine or not
A theoretically perfect next token prediction machine has limitless utility. Predict the weather, stock market, lottery number, the next step of groundbreaking cancer research, etc etc. That's not the argument against current LLMs being capable of being AGI.
Replies
bowsamic • today at 8:09 AM
A theoretically perfect next token prediction machine is just an LLM with a temperature of 0, which performs worse than one with a non-zero temperature (i.e. imperfection)
The "prediction" has nothing to do with predicting the future, it just means choosing the most likely next token for existing human text
A theoretically perfect next token prediction machine would be uncomputable.