logoalt Hacker News

TomGarden • today at 8:43 PM • 0 replies • view on HN

I partly agree with the sentiment, but this is also the first time I've seen an actual lab announce they optimized for consumer hardware (very expensive, but still consumer).

It's kind of absurd that no non-quantized MOE model exists that's sweet spotted for 128GB Macs, for example. I hope more open labs follow this lead but also offer lower tier models, perhaps specialized on certain types of tasks