logoalt Hacker News

Topfi • today at 12:32 AM • 0 replies • view on HN

Hold up, 300-500tps at p50? At p99, even something like Opus 5.5 on fast reliably hits 330tps+, so that'd be expected but if truly p50, wow. And no regressions in tool call and structured output vs the official endpoint? Would love to test that with my evals, please share.