logoalt Hacker News

technoabsurdistlast Friday at 11:53 PM2 repliesview on HN

yes it is 213 tok/s single stream (so per user)


Replies

unrvl22last Saturday at 6:22 AM

that 213 wasn't achieved when saturated though. was probably more like 30 tps per stream when doing 2.6k tps.

3836293648last Saturday at 12:14 AM

So per subagent*.

show 1 reply