logoalt Hacker News

zozbot234last Sunday at 10:48 PM2 repliesview on HN

> I don't think cloud models are going away; the hardware for good perf is expensive

I think local AI will win in its niche by repurposing users' existing hardware, especially as cloud hardware itself gets increasingly bottlenecked in all sorts of ways and the price of cloud tokens rises. You don't have to care about "bad" performance when you've got dedicated hardware that runs your workloads 24/7. Time-critical work that also requires the latest and greatest model can stay on the cloud, but a vast amount of AI work just isn't that critical.


Replies

reissbakeryesterday at 2:53 AM

Users do not have an existing $80k of hardware, are not going to buy $80k of hardware for worse performance than paying $100/month, and models are continuing to grow in size while memory grows in price.

show 2 replies
ai_fry_ur_brainlast Sunday at 11:05 PM

[flagged]

show 1 reply