logoalt Hacker News

andy99yesterday at 3:44 PM2 repliesview on HN

The gguf is up and works, I don’t know if it’s them or unsloth that’s facilitated this but it’s nice because e.g. Inkling still doesn’t appear to have support in llama.cpp which makes it irrelevant to a class of user.

Unfortunately I don’t have enough experience with Qwen 27B to immediately compare, but I do it’s Qwen 3.6 35B A3. It’s much slower obviously but it seems to be way more efficient with its thinking to the point that using it might actually be faster. I find Qwen and some others rehash the same things over and over when thinking without getting anywhere, in mg limited checks here Muse is much better.


Replies

dofmyesterday at 3:56 PM

I don't really use the Qwen 3.6 27B though I do test the variants (Bonsai, ThinkingCap).

I really like the 3.6 35B A3B for experiments, and it seems OK, but as you say, it spins round in thinking loops more than say the 26B Gemma 4 does. If Muse doesn't actually-wait itself as much it will be very interesting.

I am just downloading it to run my small tests.

show 2 replies
segmondytoday at 12:42 AM

There's an inkling branch, go to unsloth, read - https://unsloth.ai/docs/models/inkling