alt Hacker News> Apple’s most powerful Mac raises the bar for local AI
Wow, "Local AI" mentioned in the subheading above the fold - it's really awesome to see Apple leaning into this use case and I think it will definitely pay off for them going forward. Fingers crossed Apple is able to put some engineering effort towards shipping with one of the frontier open weight models included and optimized exactly for the machine.
Replies
The local ai is used by Apple services, mostly. Though there is a Swift SDK to access it, apparently.
The product marketing managers write for the target audience; of course they know lots of people buying these are the local LLM crowd.
I actually wouldn't want a serious model shipping 'on disk'. Models release so often, it's going to get outdated quickly. LMStudio is trivial to set up.
I am absolutely open to being corrected but I can't think of a single current era FOSS project that apple is optimizing and shipping with their computers.