alt Hacker NewsThe exciting thing about this is in them optimizing for inference on Macs. This, and optimization for other consumer hardware, is where local AI needs to go
The exciting thing about this is in them optimizing for inference on Macs. This, and optimization for other consumer hardware, is where local AI needs to go
Given the size of Macs (2 or 4 of them) required to run it, they're just paying lip service to that option. Other models, e.g. deepseek flash, are much more practical size. Even that takes a 96 or 128GB ram Mac.