logoalt Hacker News

octomind • today at 8:13 PM • 1 reply • view on HN

Finally democratizing AI access to, checks notes, people with no less than two Apple M5 Ultra Studios on their desktop.


Replies

TomGarden • today at 8:43 PM

I partly agree with the sentiment, but this is also the first time I've seen an actual lab announce they optimized for consumer hardware (very expensive, but still consumer).

It's kind of absurd that no non-quantized MOE model exists that's sweet spotted for 128GB Macs, for example. I hope more open labs follow this lead but also offer lower tier models, perhaps specialized on certain types of tasks