This is such a weird project. Like where is this running at scale? Where’s the realistic plan to ever run this at scale? What’s the end goal here?
Don’t get me wrong... It’s super cool, but I fail to understand why money is being spent on this.
The end goal is that Macs become good local LLM inference machines and for AI devs to keep using Macs.
The end goal is that Macs become good local LLM inference machines and for AI devs to keep using Macs.