alt Hacker NewsThey make it sound like they improve Qwen by reading raw weights. They don't. In fact the experiments that use raw weights have very little to do with the experiments that work on larger models.
Replies
nater5000 • today at 3:25 PM
>They make it sound like they improve Qwen by reading raw weights.
Weird, because they explicitly and clearly explain exactly what they did and didn't do.
Did you actually read the original post or just take the word of some HN comments at face value?
The paper makes it ridiculously clear what they do and don’t do. And they make the reasons why clear too. There is absolutely nothing interesting in this new article.