logoalt Hacker News

dpoloncsakyesterday at 7:59 PM2 repliesview on HN

>Apple is sitting out the AI race

Then why does my M4 run models at TOK/s that similar priced GPUs cannot?


Replies

bitpushyesterday at 8:02 PM

iPhones can run Uber app but nobody would claim Apple is in the ride sharing business.

show 1 reply
bigyabaiyesterday at 9:43 PM

From TFA:

  For Private Cloud Compute specifically, the system is described as underpowered and perhaps more trouble than it’s worth. Updating the software is apparently trickier and takes time, and more fundamentally the chips (believed to comprise right now of modified M2 Ultra processors) are not powerful enough to run the latest frontier models like Gemini, which the new Siri will be based on.
show 1 reply