logoalt Hacker News

andai • today at 6:34 PM • 1 reply • view on HN

Is the thing here that, we can get massive performance and efficiency gains by using vector space instead of English, but then we won't be able to know what's going on?

Although, I thought we proved multiple times years ago that the model's decision-making process and reasoning tokens don't necessarily overlap?


Replies

Taikonerd • today at 7:17 PM

> Is the thing here that, we can get massive performance and efficiency gains by using vector space instead of English, but then we won't be able to know what's going on?

Yes, exactly. People sometimes call the vector-space thought "neuralese."

➕ show 1 reply