logoalt Hacker News

serf • today at 12:50 AM • 1 reply • view on HN

>How many tokens/s do you need for a coding agent to feel like Claude or codex?

it's kind of a loaded question, this model gets a lot of tok/s but reasoning is forced on; the time-to-answer is really a combination of things like "how much does this thing want to over-reason" and "how much does this thing like tool use?" .


Replies

nico • today at 12:58 AM

You are right, they are not exactly the same thing, just wanted to have a reference point

When running locally usually I have to trade off speed for a better model. I can run decently big models at about 2tk/s, or a pretty dumb one at 40-100tk/s

➕ show 1 reply