logoalt Hacker News

vatsachak • today at 5:06 PM • 1 reply • view on HN

Why is ML so misleading these days? No this model does not score 80%+ on DeepSWE, it merely chooses the best possible idea of Opus 5 at every stage, increasing the performance by 5%.


Replies

aoeusnth1 • today at 5:45 PM

Yeah, the github landing page is much less misleading and clearly says this. I don't know why they try to make the marketing page gloss over this detail... it speaks to the mindset of the authors.