alt Hacker NewsThis seems like an incredibly bad deal, but maybe they're probing to see if people will pay more
You know if people pay for this en masse it'll be the new default pricing, with fast being another step above
This seems like an incredibly bad deal, but maybe they're probing to see if people will pay more
You know if people pay for this en masse it'll be the new default pricing, with fast being another step above
Not at all. Some work is the combination of short duration, bottlenecking in nature, and serial.
Example: You're merging 3 branches, and there's a minor merge conflict.
You only need 15k tokens to fix it, so it's short duration. And it's bottlenecking. And it's a serial task.
This belongs on Cerebras or whatever.
Once fixed, go back to slower compute.