logoalt Hacker News

kzrdudetoday at 10:47 AM1 replyview on HN

I think (maybe I missed something) that identical size and quant versions of Qwen 3.5 and 3.8 should run at the same speed. It’s the exact same architecture.


Replies

madducitoday at 10:53 AM

Tried the 4 Bit versions. It loads, bit the <thinking> output isn't even coming out.