logoalt Hacker News

qserayesterday at 11:35 PM1 replyview on HN

>This is obviously no longer the case today.

Advancement in capability does not mean the mechanism is the different. The LLM name denotes a very specific mechanism..


Replies

frozenseventoday at 12:57 AM

>The LLM name denotes a very specific mechanism..

No, not really. This is just the term that stuck around. The "large" is now up to five orders of magnitude larger and "language model" has gone far beyond any simple notion of modeling a singular natural language. And anything you'd cite about transformers, or tokens, or autoregression, etc., is more of a factoid about what works best and happens to be the most convenient in the here and now. I see all of this as an unbroken continuation of work that's been going on since the 1940s.

Instead of trying to play word games, why can't you just read Tao's article?