logoalt Hacker News

quotemstr • today at 6:07 PM • 1 reply • view on HN

No, this AI-written paper does not demonstrate direct weight editing. Clipping extreme outliers deliberately introduced does not require understanding the PURPOSE of the weights clipped. Likewise, abliterating a model (which is what the loop fix is!) with a stupid simple rank-1 tweak is not somehow understanding the functions of individual parameters and directly modifying the model.

These are all techniques humans have been using for years. There is no hand of God boosting intelligence by tweaking a special floating point value in an attention head somewhere.


Replies

jackb4040 • today at 8:13 PM

Thank you! If were able to natively update weights as a way of learning in real time during inference, that would be one thing. But using scripts to modify weights in the same way as human researchers (and in all likelihood trained on a massive corpus of them doing so) is just looped code generation which it's been doing for years now. It can be impressive / interesting, but it's not a phase shift.