logoalt Hacker News

netikayesterday at 3:57 PM1 replyview on HN

In my testing, qwen-3.6-27b in full precision is well below sonnet, but above claude haiku in coding tasks. Gemma is not even close to qwen, it’s much, much worse.


Replies

robertkarltoday at 1:38 AM

How do you test? I made this comment elsewhere... but I don't see a good benchmark that covers "how good is this thing at actually driving coding with tool use locally"?