logoalt Hacker News

gavinray • yesterday at 5:19 PM • 9 replies • view on HN

Benchmark scores recolored for readability:

https://i.imgur.com/IDFGuJU.jpeg


Replies

philrenaud • yesterday at 5:54 PM

Serendipitous timing, but I've been building a little chrome extension [0] for doing exactly this sort of thing (highlighting tables automatically, especially when numbers don't necessarily correlate good=green, bad=red). Model pricing and comparisons are one of the main things I checked (low cost good, high benchmark score good).

[0] Practical Data (https://practicaldata.dev/ / https://chromewebstore.google.com/detail/practical-data/oeoo...)

tidbeck • yesterday at 5:43 PM

Zoomed on the image and Imgur now also requires an app…

➕ show 3 replies
loeg • yesterday at 7:12 PM

Huh. Do people actually find that Fable-5.1 is worse than Opus-5.5 for any task?

➕ show 6 replies
jsphweid • yesterday at 5:46 PM

On one hand this looks like a joke?

On the other hand I'm a strong protan colorblind guy (red doesn't register to me very well at all).

➕ show 1 reply
no-name-here • yesterday at 6:39 PM

Thanks.

Also, I'm curious if you just asked an AI to _OCR the original image+update it_, or if you used a different process?

➕ show 1 reply
gradus_ad • yesterday at 6:46 PM

What is SWE-Sweep?? Shocking to see such poor evals.

_s_a_m_ • yesterday at 9:26 PM

The only important benchmark is FrontierSWE and there it is of course 3rd. even after Opus 5.5 which is relatively old compared to their brand new model..

alienbaby • yesterday at 6:12 PM

am i missing something or have they updated the page? the blue highlights and grey arent that bad to read?

varispeed • yesterday at 6:48 PM

Imgur is not available in the UK due to censorship.