logoalt Hacker News

qseratoday at 8:11 AM1 replyview on HN

It can't, simply because the textual description of a concept is different from the concept itself.


Replies

red75primetoday at 8:29 AM

Obviously, a concept (which is an abstraction in more ways than one) is different from a textual representation. But LLMs don't operate on the textual description of a concept when they are doing their thing. A textual description (which is associated with other modalities in the training data) serves as an input format. LLMs perform non-linear transformations of points in their latent space. These transformations and representations are useful not only for generating text but also for controlling robots, for example (see VLAs in robotics).

show 1 reply