logoalt Hacker News

Zambyte • today at 10:39 AM • 4 replies • view on HN

Superior? Sure. But do people need the capabilities beyond what can be reasonably achieved with local models? I think the people that actually sit in that gap are vanishingly small, and if your title contains "Engineer" or "Developer" or something like that, you are not one of those people (at least for doing your job)

As for faster, maybe? It depends on the metrics and what you're doing with it. If you mean TPS, no, I get much higher TPS and even faster TTFT on my local setup than frontier models. If you mean time to complete tasks... maybe. If you're throwing whole projects at it to vibecode, yeah, a frontier model will dump slop so fast it'll make your head spin. If you're doing actual methodical development, like doing spec-driven development and actually reading the specs before spinning off agents to implement them, rather than just having another agent review it and yolo, you'll find that frontier models don't really push the needle that much, and you'll be making high-quality projects.


Replies

jmkni • today at 12:29 PM

I might not need them but I'll sure as hell take them if they are available

whatarethembits • today at 12:27 PM

What’s your local setup? I’d love to give it a spin; lack of 5 hours limits is much needed.

➕ show 1 reply
enraged_camel • today at 3:27 PM

>> But do people need the capabilities beyond what can be reasonably achieved with local models?

Yes? If you're building anything reasonably complex, it is a ton of work to keep everything in your head so that different parts of the system work seamlessly and work you do in one area does not adversely affect another area.

actionfromafar • today at 12:23 PM

Every hour baby-sitting a local model can be extremely expensive in billable hours.