logoalt Hacker News

nekitamoyesterday at 5:25 PM1 replyview on HN

This tracks, in my experience the 27B is better at coding and instruction following. I'm shocked at how much of a difference the dense models vs MoE makes.

But it's a moot point, because for local inference on consumer hardware, the MoE is so much faster.


Replies

apitmanyesterday at 5:36 PM

Are you sure the difference is from MoE and not that 3.6 is newer?

show 1 reply