alt Hacker Newshttps://huggingface.co/meta-models/Muse-Spark-Open-816B-A42B...
816B model, A42B active parameters
Unsloth and Meta have guides on how to run the model, but allow me to summarize: You & Me won't be running this one.
Replies
scotty79 • today at 8:05 PM
> The 2-bit quant fits on devices with 256GB of RAM, VRAM or unified memory.
Ouch. I wonder how it compares to Qwen 3.8 running with 4-bit quant on 10 times less VRAM.
Not at an appreciable token rate. I wonder if these large open weight models are considered safer to release for that reason? I'm thinking no because any small to medium size criminal organization or state funded group will be able to cobble together the resources to achieve some kind of runtime. Even at 10 tok/sec, making bioweapons at 10 tok/sec is concerning.