When that article was first published , I started looking into llama.cpp. With the help of an LLM I researched the knobs to turn that made most sense.

Things went from "local models are useless unless you have a 512GB GPU I guess" to "oh.. I can do a lot of stuff locally now!"

From the Ollama docs for this new model:

Ollama's MLX engine provides state-of-the-art performance on Apple Silicon, with support for DFlash and image input:

ollama run muse-glimmer:30b-mlx

What do you use instead?