logoalt Hacker News

FrustratedMonky • yesterday at 1:09 PM • 2 replies • view on HN

Does this describe a very powerful LLM, like Astra, editing smaller models?

Could Astra edit itself?


Replies

rsfern • yesterday at 2:16 PM

I don’t understand the negative reactions to your post, it’s a good insight.

Basically the weight edit approach is find a semantic direction for the undesirable behavior and steer away from it. With access to the weights I see no reason a model (even one as large as Astra) couldn’t apply that principle to itself. This probably includes at runtime if you wanted to give the model write access to itself

➕ show 1 reply
kragen • yesterday at 1:28 PM

No, it describes a linear optimization algorithm from the 01940s editing a Qwen model with billions of parameters.

➕ show 2 replies