alt Hacker Newslocal llm don't make sense currently consumer compute is not upto mark it may take atleast 7 more years to be usable
Replies
Winfred-zz • yesterday at 9:36 PM
In my own experience, qwen3.8-27b 4bit can consistently find bugs in software written by sonnet 5 and opus 5. But it does do that at maybe 1/10th the speed. Still a pretty good deal if you're coding without wanting to spend big.
qwen3.8-27b 4bit has a following specifically for being exceptionally gifted for such a small model.
➕ show 1 reply
It literally is usable now. A 5060 for $800 can run qwen3.8-27b 4bit at >40t/s, and the model beats opus 4.6 (max).