logoalt Hacker News

jayd16yesterday at 8:43 PM2 repliesview on HN

> _determining_ the next token based on a prediction

Also known as predicting.


Replies

Borealidyesterday at 8:47 PM

I think the most useful word in both cases is "extrapolating".

An LLM extrapolates from its context window to the immediate next token. This word applies whether you view what's happening as "reasoning", "prediction", or as a math function.

Veedractoday at 3:05 AM

No, those aren't synonyms at all.

If I steer a car to avoid a predicted collision with a wall, this is not me 'predicting' the car. I am steering the car based on a prediction.

show 1 reply