Benchmark scores recolored for readability:
Zoomed on the image and Imgur now also requires an app…
Huh. Do people actually find that Fable-5.1 is worse than Opus-5.5 for any task?
On one hand this looks like a joke?
On the other hand I'm a strong protan colorblind guy (red doesn't register to me very well at all).
Thanks.
Also, I'm curious if you just asked an AI to _OCR the original image+update it_, or if you used a different process?
What is SWE-Sweep?? Shocking to see such poor evals.
The only important benchmark is FrontierSWE and there it is of course 3rd. even after Opus 5.5 which is relatively old compared to their brand new model..
am i missing something or have they updated the page? the blue highlights and grey arent that bad to read?
Imgur is not available in the UK due to censorship.
Serendipitous timing, but I've been building a little chrome extension [0] for doing exactly this sort of thing (highlighting tables automatically, especially when numbers don't necessarily correlate good=green, bad=red). Model pricing and comparisons are one of the main things I checked (low cost good, high benchmark score good).
[0] Practical Data (https://practicaldata.dev/ / https://chromewebstore.google.com/detail/practical-data/oeoo...)