logoalt Hacker News

seizethecheese • yesterday at 6:23 PM • 2 replies • view on HN

Speaking of arena comparisons of K3.1 and DS4.1-Flash, we're spinning one up that's more relevant than design, I think: https://agentduel.com/leaderboard

Here, DS4.1-Flash and K3.1 are basically tied, with K3.1 being slower and more expensive. Big error bars, though.

Even with error bars, DS4.1-flash is clearly an impressive model.


Replies

reissbaker • yesterday at 6:31 PM

If your benchmark puts DS4.1-Flash at the same tier as K3 or K3.1, I'm sorry to say your benchmark is broken. It really isn't, as much as I wish it was.

➕ show 1 reply
eunos • today at 9:16 AM

It's quite hilarious that kimi K3.1 was competitive against Opus 5.5 and a bit lagging against DS V4.1F. While DS struggled against Opus