How is this easier than using lmstudio or omlx or whatever your favourite runtime is ?
It’s maybe a bit interesting that Jetbrains are making moves to integrate with local models more closely, but I think claiming this is “easier” is incorrect for most users.
Anything good to run on Mac M5 Max with 48GB? is this even worth trying? so far I found the responses so slow compared to the paid subscriptions...
It seems to me that Qwen3.6-35B-A3B is still the local LLM leader, because 27B in either of the latest releases is just too slow to be usable compared to OpenCode Zen free models, or OpenRouter free models.
Sad a Qwen3.8-35B-A3B model wasn't released.
Also, I think this is just an ad.
Uh...
brew install llama.cpp
llama serve -hf unsloth/Qwen3.6-35B-A3B-GGUF:UD-Q4_K_M
open http://127.0.0.1:8080
Curious why they're using 3.6-27B and not 3.8-27B which is competitive with Opus 4.6 (https://huggingface.co/Qwen/Qwen3.8-27B)