logoalt Hacker News

aliljetyesterday at 4:21 PM3 repliesview on HN

Where can a user reasonably host this in an affordable way to access the local LLM revolution?


Replies

satvikpendemyesterday at 7:38 PM

Unsloth Studio with its MTP support: https://unsloth.ai/docs/models/qwen3.6#mtp-guide

julianlamyesterday at 6:10 PM

Try llama.cpp and Qwen3.6-35B-A3B

Good balance of intelligence and speed.

plagiaristyesterday at 5:29 PM

I think their Max models are far bigger than fits on consumer hardware. People are typically using Apple, AMD Halo, or dGPUs if/when they do smaller versions. Those are all varying degrees of "affordable."