alt Hacker NewsOk speed (202.7 tok/s) and value (1.25 -> 2.50) look great, with pretty decent intelligence.
Replies
Cakez0r • today at 11:28 AM
202.7 tok/s is only OK speed? Which providers are you using that are significantly better than that?
➕ show 2 replies
Ok speed (202.7 tok/s) and value (1.25 -> 2.50) look great, with pretty decent intelligence.
202.7 tok/s is only OK speed? Which providers are you using that are significantly better than that?
The problem with speed is that they usually are very fast for first few weeks and then suddenly much slower. They did such trick when they advertised Grok 4 fast ( dropped from 200 tps to 60tps)