>Apple is sitting out the AI race
Then why does my M4 run models at TOK/s that similar priced GPUs cannot?
From TFA:
For Private Cloud Compute specifically, the system is described as underpowered and perhaps more trouble than it’s worth. Updating the software is apparently trickier and takes time, and more fundamentally the chips (believed to comprise right now of modified M2 Ultra processors) are not powerful enough to run the latest frontier models like Gemini, which the new Siri will be based on.
iPhones can run Uber app but nobody would claim Apple is in the ride sharing business.