that's a matter of hardware, Cerebras reports 1500 tok/s
https://inference-docs.cerebras.ai/models/qwen-3.8-27b
Input $0.99 Output $1.49
That times 5 is steep!
Input $0.99 Output $1.49
That times 5 is steep!