alt Hacker NewsThe people saying that local models can easily replace the real Frontier Models from Anthropic or OpenAI are just not using it for the same things you and I do.
They seem to be happy with their small usages.
For everything I do, i see huge differences in Quality and Speed.
Even when I try an open model on a 4090, the PC gets warm/hot very fast, I struggle with context length.
Replies
can you give example, prompt require context window > local model, or higher Quality/Speed, that local model can not do, open source example?
> The people saying that local models can easily replace the real Frontier Models from Anthropic or OpenAI are just not using it for the same things you and I do.
> They seem to be happy with their small usages.
Oh yes, we're terribly inferior people. Just living on scraps from the masters' tables.
This:
Having currently a very tech-intensive chat running for more than one week, this is where the frontier models really shine: Its no more 2024 or so, where they lost context on large discussions, you can do really great work with the frontier models - the local models will be a thing in a few years, if RAM & CPU developed further, this will happen: in 2035 like, you will be able to run "Claude-like experience" on your iPhone.