I wouldn't exactly call it snappy, but faster than Pro, yes.
Single request depth on vllm with dspark, I'm getting ~200 tps, I'd say it's pretty snappy.
alt Hacker News
Single request depth on vllm with dspark, I'm getting ~200 tps, I'd say it's pretty snappy.