logoalt Hacker News

maplet • today at 3:27 AM • 3 replies • view on HN

It scores a 43 on Artificial Analysis with an average cost of $3.27 [1]. For reference, GPT-6.1 Sol (medium) gets a 46 with an average of $0.36.

[1]: https://artificialanalysis.ai/models/qwen4-max


Replies

esperent • today at 3:32 AM

The table on that page shows gpt 6.1 sol (max) at $1.27 per task and it's the only model cheaper than Qwen 4 max.

By comparison opus 5.5 (max) is $10.01.

If they are not testing Chinese models with less than max thinking, then we should only compare them to other models also at max thinking.

➕ show 1 reply
seizethecheese • today at 3:49 AM

Does anyone really believe the cost data for benchmarks? Pretty sure all models will behave differently at this point when they get benchmark shaped questions.

(And I’m sitting on data showing Sol 6.1 and Qwen 3.8 Max cost roughly the same per task, for real tasks.)

➕ show 1 reply
montroser • today at 3:45 AM

Yeah, it's in the same ballpark as Kimi 3.1. Both of which are obviously open weight, so that's at least a big differentiator from Sol. Let's hope against hope that the much smaller flash model might beat deepseek v4.1 flash and run for as cheap.