logoalt Hacker News

AndrewKemendo • yesterday at 6:25 PM • 2 replies • view on HN

I run my own local models and there’s no world where “normies” can do this.

In fact, I just switched from a 96 GB ram laptop to a 32 GB ram laptop specifically so I can have GPU acceleration because 20 toks can’t replace the 6000toks or whatever astra does


Replies

kennywinker • yesterday at 6:31 PM

> there’s no world where “normies” can do this.

Not today. But when it turns into a $600 brick you plug in next to your router, that's gonna work for most people.

For today, I'm speaking to software developers - who can 100% handle setting up a local AI system - it's only as hard as building a PC.

➕ show 2 replies
3eb7988a1663 • yesterday at 6:38 PM

The normie use cases need less performance, so it could be fine. Review this email, presentation slide, make a flyer for the soccer game, what should I do in Barcelona, etc. If you are not running gas town, you don't necessarily need that much.