logoalt Hacker News

ArvidSuyesterday at 6:36 PM1 replyview on HN

A ThinkingCap variant of Qwen 3.8 27b would be extremely interesting.

https://huggingface.co/bottlecapai/ThinkingCap-Qwen3.6-27B

And then a Bonsai ternary on top of that model.


Replies

kees99yesterday at 7:04 PM

Re: bonsai - unsloth's quants have Q2 (UD-IQ2) variants, which are more or less same in size.

...or did Prism do something special with their "bonsai" releases? I didn't notice anything like QAT being mentioned.

show 1 reply