alt Hacker NewsThey will cost an insane amount as well. Maybe less than subscriptions or tokens. But running massive models on laptops with batteries and poor cooling doesn’t make much sense.
Replies
ignoramous • today at 6:11 PM
> will cost an insane amount as well
We will get to a point where prosumer laptops that etch SoTA LLMs in removable silicon will be as expensive as cars.
Until hiding PII from the cloud LLM is a resolved issue, running local LLMs will remain a necessity.
There are workplaces that refuse to use LLMs because they fear the devs will expose sensitive data without care.