logoalt Hacker News

airza • yesterday at 10:30 PM • 3 replies • view on HN

The “obviously” here is puzzling. It is certainly obvious this would be better but it is not at all obvious how to do so.


Replies

modeless • yesterday at 11:53 PM

There are many obvious avenues to try. This paper proposes one. I think it's likely we'll end up with some kind of auxiliary model that monitors and/or decodes the latent space of the thinking model. Certainly it is a non-trivial problem, but I don't need to know exactly how it will work in detail to believe that it is possible.

stingraycharles • yesterday at 11:04 PM

Exactly, because the whole thing is entirely based on autocompleting the next word, which is exactly why CoT prose helps getting better predictions.

ijustlovemath • yesterday at 10:51 PM

Why people don't treat categorizing model activations as a science is beyond me.

➕ show 3 replies