alt Hacker News155T tokens/day per cluster? OpenRouter reports that last week total usage on their platform was 164T tokens. Surely all that demand couldn't be satisfied with one cluster? Are these different units of token, or maybe something got lost in translation?
Replies
Exactly... I was going to post exactly this and you called it two minutes before me. On openrouter, it is shown that 600T+ tokens are provided per month, so 20T+ per day. Openrouter is not all the world but it seems that something is not right with this 155T figure... Unless everyone is idle everywhere, waiting for demand
From the Github benchmark numbers, one GPU can do about 26k tokens/s when serving 256 users, which is about 2.25B tokens/day. A cluster would need to be close to 70k GPUs to serve 155T tokens/day (which seems doubtful).
OpenRouter routes traffic through many different providers
https://openrouter.ai/deepseek/deepseek-v4.1-flash-1017#prov...