logoalt Hacker News

pettijohnyesterday at 3:47 AM5 repliesview on HN

35B MoE is certainly a good and fast local model. I find 27B dense to be quite a bit smarter, so I daily drive that. I wish there was a ~100B MoE with maybe 10B active. It would be super smart and fast!


Replies

mattnewtonyesterday at 3:50 AM

There was a 3.5 122B 10A release -

https://huggingface.co/Qwen/Qwen3.5-122B-A10B

show 1 reply
antmanyesterday at 7:04 AM

A 35 A3B as smart as previous gen 27B would be a sweet point

traceroute66yesterday at 8:19 AM

> 35B MoE is certainly a good and fast local model. I find 27B dense to be quite a bit smarter

Isn't that just the definition of MoE vs dense ?

show 1 reply
wickedsightyesterday at 7:26 AM

I use 27B in plan mode and 35B MoE in act mode. I noticed that is the best balance for me for consistent tool calls and intelligent planning. Takes some time to switch, but it's worth it for me.

show 1 reply
nozzlegearyesterday at 4:07 AM

I've heard 27B is smarter! I tried it some time ago but couldn't get it working with my oMLX. I need to try it again.

show 2 replies