logoalt Hacker News

deauxyesterday at 7:06 PM1 replyview on HN

Here, filtered down for you. [0] Look at the individual benchmarks, not the combined one. You can tell that this model is much more benchmaxxed as its relative ranking swings between benchmarks is much larger. This is a hallmark.

[0] https://artificialanalysis.ai/models/qwen3-8-27b?models=deep...


Replies

throwa356262yesterday at 7:44 PM

I dont think this is benchmaxing.

They have simply decided to not train the model in some areas such as world physics