This tracks, in my experience the 27B is better at coding and instruction following. I'm shocked at how much of a difference the dense models vs MoE makes.
But it's a moot point, because for local inference on consumer hardware, the MoE is so much faster.
This tracks, in my experience the 27B is better at coding and instruction following. I'm shocked at how much of a difference the dense models vs MoE makes.
But it's a moot point, because for local inference on consumer hardware, the MoE is so much faster.