They aren't predicting the next token. It's quite literally not a prediction.
They're estimating a probability distribution over the next token, from which a sample is taken. Close enough.
alt Hacker News
They're estimating a probability distribution over the next token, from which a sample is taken. Close enough.