alt Hacker NewsThis was my experience a year ago on some other model they could run super fast. Routine coding tasks would hit the per-minute token limits.
Just the math there... 150k TPM... and 15k TPS means... you can run for 10 seconds every minute?
The basic math boggles the mind.
Replies
baegi • yesterday at 8:34 PM
Not sure how the rate limiting works, but it's 1.5k TPS, not 15k, so you could run it for 100s/min, which seems good enough to me
➕ show 2 replies
> means... you can run for 10 seconds every minute?
It’s one order of magnitude less TPS, but still, that’s the limit with just one user…