logoalt Hacker News

scotty79 • today at 8:05 PM • 0 replies • view on HN

> The 2-bit quant fits on devices with 256GB of RAM, VRAM or unified memory.

Ouch. I wonder how it compares to Qwen 3.8 running with 4-bit quant on 10 times less VRAM.