logoalt Hacker News

tpurves • today at 1:48 PM • 6 replies • view on HN

"Latent space representation" I have been waiting for this moment in the evolution of AI. Well, waiting with some trepidation. It seems inevitable that frontier AI's will, at some point, leave behind human-comprehensible representations of language. Purely for functional reasons, it's going to start making sense for AI agents to communicate amongst themselves in much more efficient ways than borrowing the languages of flesh-bag humans as an interface medium.

I Imagine next that programming languages, interfaces and API design starts going this direction next. Being written, expressed and optimized as blobs of high dimensional vector space. As humans we might still be able to understand some abstractions of what our AI's are talking about to each other, but maybe not more so then we understand how different regions of our own brain communicate with each other.

Replies

mparramon • today at 2:08 PM

It has already started:

  zero-graph v1
  origin source-text
  module "hello"
  hash "graph:a7f7e6899a73f3b4"

  node #decl_ad8d9028 Function name:"main" type:"Void" public:true fallible:true
  node #param_4610ae76 Param name:"world" type:"World"
  node #expr_c403020c MethodCall name:"write" type:"Void"
  node #expr_653eeb6e Literal type:"String" value:"hello from zero\n"
  edge #expr_c403020c arg #expr_653eeb6e order:0
https://zerolang.ai/
karma_daemon • today at 2:00 PM

I've been thinking the same! Haha

Even for like token efficiency it could make sense - like imagine if the representation were more compact

Agents acn already translate languages quite well. It doesn't seem crazy that they could work and think in a model specific language, and then translate back to English or something for the user

nextaccountic • today at 4:00 PM

Is it really more efficient? Any token becomes huge in latent space.

EGreg • today at 1:55 PM

I strongly believe that the future is the other way. New programming languages and environments designed for strong auditability and preventing bugs will dominate. Only bad actors will use latent space representation, and it might even be outlawed. But the bad actors will proliferate underground…

I actually built such a language: https://magarshak.com/U.html

➕ show 2 replies
TowerTall • today at 1:56 PM

Google's AI just created its own universal 'language' (2016)

https://www.wired.com/story/google-ai-language-create/

➕ show 1 reply
UltraSane • today at 2:57 PM

It seems like the most efficient method would be for LLMs to communicated by exchanged latent space representations directly. Serial language is a incredibly inefficient way to encode these, a lot like flattening a complex graph into text.