logoalt Hacker News

cptskippyyesterday at 5:37 PM3 repliesview on HN

> Qwen-3.6-35B-A3B

The A3B models are super fast but I found the A3B Q4 model ran in circles a lot and ended up taking longer to complete tasks that 27B Q6 because it kept having to redo/rethink/fix something.

I was writing extensive prompts to rein it in and it would still ignore basic directives like "never force push on the repo, ask me instead". I ended up switching back to 27B after about a week of frustration and lost productivity.


Replies

customguytoday at 12:36 AM

I'm playing experimenting with a harness and just tested how well various models follow the instructions, and how they react to the tool claiming a local temperature of 72°C

here is how qwen/qwen3.6-27b reacted:

https://pastebin.com/srf7gjfy

try to count the number of times it "thinks" okay ready, just say the thing, no wait but what if...

this isn't (a mimicry of) thinking, this is (a mimicry of) insecurity/fear

trollbridgeyesterday at 7:25 PM

We’re using 6bit quants since we have 32GB cards.

Gemma QAT is an honourable mention.