logoalt Hacker News

otabdeveloper4today at 3:27 PM3 repliesview on HN

LLMs do not match patterns. They predict one statistically most likely token (only one!) given a history of some N previously known tokens.


Replies

beardedwizardtoday at 3:30 PM

Is that prediction not based on matching previous patterns, whose frequencies are more or less encoded in the weights?

show 1 reply
lioeterstoday at 3:42 PM

> statistically most likely

Isn't that pattern matching essentially?

lennofftoday at 3:34 PM

afaik before the final sampling, every "next" token has a probability, so theoretically it could select the 10 most likely tokens (based on some kind of sampling algorithm), but you'd end up with exponentially many output-sequences, so nobody does that.

show 1 reply