logoalt Hacker News

rco8786yesterday at 1:22 PM1 replyview on HN

Not OP. But embeddings are the internal matrix representations of tokens that LLMs use to do their work. If tokens are the native language that humans use, embeddings are the native language that LLMs use.

OP, I think, is saying that once LLMs start communicating natively without tokens is when they shed the need for humans or human-level communication.

Not sure I 100% agree, because embeddings from one LLM are not (currently) understood by another LLM and tokens provide a convenient translation layer. But I think there's some grain of truth to what they're saying.


Replies

spruce_tipsyesterday at 2:59 PM

Yea I knew embeddings I just didn’t quite understand it in OPs context. Makes sense, thanks