logoalt Hacker News

jesse_dot_id • today at 10:09 AM • 3 replies • view on HN

It's because the frontier models are superior and much faster.


Replies

my-huge-pony • today at 11:01 AM

>much faster.

This really depends on your infrastructure. In this case it all depends on your hardware, and there is no secret sauce, you can buy the same GPUs or better than the big players are using. Self-hostef GLM in our company is faster than any commercial model. Of course the hardware was not cheap, but completely manageable for a medium or large company.

➕ show 1 reply
Zambyte • today at 10:39 AM

Superior? Sure. But do people need the capabilities beyond what can be reasonably achieved with local models? I think the people that actually sit in that gap are vanishingly small, and if your title contains "Engineer" or "Developer" or something like that, you are not one of those people (at least for doing your job)

As for faster, maybe? It depends on the metrics and what you're doing with it. If you mean TPS, no, I get much higher TPS and even faster TTFT on my local setup than frontier models. If you mean time to complete tasks... maybe. If you're throwing whole projects at it to vibecode, yeah, a frontier model will dump slop so fast it'll make your head spin. If you're doing actual methodical development, like doing spec-driven development and actually reading the specs before spinning off agents to implement them, rather than just having another agent review it and yolo, you'll find that frontier models don't really push the needle that much, and you'll be making high-quality projects.

➕ show 3 replies
iugtmkbdfil834 • today at 10:41 AM

They are faster, but the distance from superior is changing daily. Naturally, things like purposefully kneecapping the product does not help.