logoalt Hacker News

girvolast Monday at 9:14 PM5 repliesview on HN

Gemma is better than Qwen at everything except coding, in all my evaluations. Which is a shame because that is what I use them for!


Replies

automajiclyyesterday at 4:01 PM

I have a M1 Macbook Pro...with only 16gb and I struggled with Qwens2.5-14b trying to do large projects. I loved Qwen but I had to try and do something different. So I switched to Gemma4-12b which looking at it now, seems more like a downgrade than an upgrade.Can you refer me to any Qwen coding models that wont choke my poor 16gb and also connect contextually? I need that context. I love the laser point focus, but I need context and basic understanding of that context.

show 1 reply
UncleOxidantlast Monday at 10:47 PM

It would be great if the Gemma folks would release a code-focused model. Probably won't happen, but it's fun to dream.

show 2 replies
lambdayesterday at 2:54 PM

I haven't run a proper eval, but I've been getting better luck with Qwen models than Gemma on plant and animal identification using vision.

I do like Gemma for translation, however.

ekianjolast Monday at 11:54 PM

gemma is also worse for tool calling. not just coding

show 1 reply