logoalt Hacker News

kzrdudetoday at 7:28 AM0 repliesview on HN

27B means it has 27 billion parameters, but how that translates to model size depends on the model architecture. For Qwen 3.5 architecture (same as 3.8) the native size is around 55 GB memory. So you need quantization to fit it in 32 GB.

Go here: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF

See the right hand side panel, you see a whole palette of quantizations and their respective sizes. Should give you an idea. Note that these are not the only quantizations available.