logoalt Hacker News

TobiasJacob • today at 12:30 PM • 2 replies • view on HN

I'm still hoping some future LLM is good and small enough for people to run local AI for everyday life.


Replies

jrm4 • today at 2:51 PM

It's interesting trying to be an AI "moderate," which as the owner of a 16gb card I definitely am. Still working on the balance, but it really does feel like I'm going to land on something like "use external AI services to build a few tools, but use my local rig to actually handle everything personal once those tools are built."

trollbridge • today at 1:55 PM

Already here. 3.8-27b is good enough.

5 years ago it would have been science fiction

➕ show 2 replies