logoalt Hacker News

mapontosevenths • yesterday at 9:28 PM • 1 reply • view on HN

Are OpenAI's models delivering 50% (or more) completed tasks than they were last month? Are they delivering 50% more than Anthropic per token?

Nope to both. Not even close.

The only way it works is if you define "task" in a way that OpenAI is good at it and Anthropic isn't.


Replies

_aavaa_ • today at 1:46 AM

First of all, only the $200 plan got a cut.

Second of all, barring more cuts, yes I do think the $20 and $100 plans do deliver more tasks because the models have gotten cheaper in the meanwhile (like this very announcement).

> Are they delivering 50% more than Anthropic per token?

So say the public benchmarks. Pull up artificial analysis, “Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index”:

Sol 6.1 (max): $1,082 Opus 5.5 (max): $8,708 Sonnet 5.5 (max): $7,260

>7x difference in cost for the same tasks.

➕ show 1 reply