alt Hacker News> The people saying that local models can easily replace the real Frontier Models from Anthropic or OpenAI are just not using it for the same things you and I do.
> They seem to be happy with their small usages.
Oh yes, we're terribly inferior people. Just living on scraps from the masters' tables.
It wasn't meant as a dismissive comment.
I do plenty of experiments of things i always wanted to do and they just don't work with local models.
Finetuning of some ML models for a specific usecase, some 4k demo idea i had, small browser games to show others game mechanic ideas i had for ages, analysis tools etc.
Even just playing around with some Ghidra eats context like nothing.