logoalt Hacker News

nightski • today at 8:35 PM • 1 reply • view on HN

From what I saw in the paper, no they did not. They tested that the specific change introduced increased performance on a single task (the one mentioned in the prompt). They did not study the impact of that change on overall model performance across a variety of benchmarks. But maybe I missed something.


Replies

lnenad • today at 9:11 PM

But increasing performance on a single task was the point of the change?

➕ show 1 reply