logoalt Hacker News

erutoday at 8:52 AM1 replyview on HN

They are next token producers. I would only call it a predictor, if it's trained to predict tokens (ie just after pretraining).

Just like humans produce one word after another when they talk, but they don't generally try to imitate other humans.


Replies

wood_spirittoday at 9:26 AM

Don’t people pick up language, vocabulary and dialect from those around them? Perhaps it’s subconscious but humans are imitating other humans all the time?

show 1 reply