Local is becoming ever increasingly scarce and cost prohibitive. It's kind of bleak out there right now. A minimum bar to entry for decent local AI (something that can run a 27B tier model with some reasonable context) is going to set you back a year or five worth of AI API token costs.
alt Hacker News
Local is becoming ever increasingly scarce and cost prohibitive. It's kind of bleak out there right now. A minimum bar to entry for decent local AI (something that can run a 27B tier model with some reasonable context) is going to set you back a year or five worth of AI API token costs.