I run my own local models and there’s no world where “normies” can do this.
In fact, I just switched from a 96 GB ram laptop to a 32 GB ram laptop specifically so I can have GPU acceleration because 20 toks can’t replace the 6000toks or whatever astra does
The normie use cases need less performance, so it could be fine. Review this email, presentation slide, make a flyer for the soccer game, what should I do in Barcelona, etc. If you are not running gas town, you don't necessarily need that much.
> there’s no world where “normies” can do this.
Not today. But when it turns into a $600 brick you plug in next to your router, that's gonna work for most people.
For today, I'm speaking to software developers - who can 100% handle setting up a local AI system - it's only as hard as building a PC.