Apple’s System Model is actually pretty good but is hard-limited to a 4K context length. This is OK for small Python utilities that need a model for applications that operate on small amounts of data, but is a disappointing limitation.
That said, and this is off topic: Siri on the newest iOS beta is surprisingly good now. I asked it what model it was using yesterday and it said Gemini for difficult problems, then secure Apple model in cloud, and local Apple model.
Looks like iOS 27 ships with a 20B sparse model for on-device work, so I wonder if that comes with a context length bump. They're still pushing for better local models, which is a good sign for the future for their products.
https://runaihome.com/blog/wwdc-2026-apple-ai-home-lab-verdi...