logoalt Hacker News

jvanderbotyesterday at 7:27 PM1 replyview on HN

But it is a next token predictor.

Recursively invoked.

With carefully selected context.

And massive investment in RL to tune token selection.

And the ability to use cli tools on other folks' machines.

That's a powerful system built around a conceptually simple technology: Next token predictors.


Replies

atleastoptimalyesterday at 7:36 PM

Yes this is correct. The thing is not about the term next-token predictor being correct, but because of the connotative weight of that phrase as a implicit trivialization of LLM abilities, which is how it is often used.

show 2 replies