alt Hacker NewsTaking the benchmarks in the article at face value, this is ~on par with Opus 5.5 for ~1/4 the price!
Replies
entrope • yesterday at 6:45 PM
Taking the benchmarks (as reported by OpenAI) at face value, why wouldn't they show Opus 5.5 on the OS world benchmark, and show no Anthropic models at all on the "factual error rate" benchmark
enraged_camel • yesterday at 6:19 PM
...no it's not? At max effort, it scores 50% on terminal bench vs. Opus 5.5's 70%.
➕ show 1 reply
Which is why I don't take the benchmarks at face value...