i agree.

i believe that for most people on the street, for most tasks, a Chat GPT 3.5 era LLM is sufficient enough. sprinkle in tool calling and other things, and that becomes enough. if you can prioritize that level of a model on-device (baking it in etc), then you can bifurcate AI users between those unwilling to pay and those who are willing to pay A LOT for frontier model performance.

This question hinges on whether model advancement plateaus enough for machine sized models to compare to frontier performance. If it does, the answer is yes. If it doesn’t, the answer is no

Neural machines were always going to be an alternative computing paradigm to von Neumann machines. Had it not been for Minsky we would arguably have gotten to a point where they're useful sooner. But why do you say that as if it's a small thing?

Apple’s System Model is actually pretty good but is hard-limited to a 4K context length. This is OK for small Python utilities that need a model for applications that operate on small amounts of data, but is a disappointing limitation.

That said, and this is off topic: Siri on the newest iOS beta is surprisingly good now. I asked it what model it was using yesterday and it said Gemini for difficult problems, then secure Apple model in cloud, and local Apple model.

I have thought this for a while. Computing 1.0 meant that we needed to learn the computer’s language to interact with the computer fully. Computing 2.0 is that now the computer has learned our language instead.

Why wait? People are already doing their work on OpenAI and Anthropic's servers, Apple Intelligence servers could quickly subsume any "local" model work that you want to do.

That way everyone has access, even with older devices, and it's a subscription! Then Apple can tie their APIs into the ecosystem you love at a flat cost you can afford. No need to support local model integration in the first place, problem solved.

> Does the LLM become another interface to computing?

It already is.

or the other way where primary interfaces ppl use computing arent apple devices like laptops and phones.

based on their apple intelligence demos they are optimizing their products for their core demo of 55-95 year old boomers who talk out loud to think and read every page of the nytimes. you are miles away from the US consumer product experience here.