alt Hacker NewsI don’t understand the negative reactions to your post, it’s a good insight.
Basically the weight edit approach is find a semantic direction for the undesirable behavior and steer away from it. With access to the weights I see no reason a model (even one as large as Astra) couldn’t apply that principle to itself. This probably includes at runtime if you wanted to give the model write access to itself
Agreed. You could look at a previous session which got the right answer eventually and make edits until the path to the right answer was more direct.
It's not clear if this would generalize to other related uses, or how disastrous it would be to unrelated uses, but it's worth studying. Feels like a sort of agentic Lamarckism.