logoalt Hacker News

thot_experimenttoday at 2:39 AM0 repliesview on HN

q6 is fine for that qwen with ctx @ q8, and the dense models of that size are solid at q4 with q8 ctx