Except that's for pathetically small datasets.
What real datasets exist where this would be a worthwhile trade off versus simply owning the hardware?
The numbers are so bad that underpowered local hardware would still beat it.
yep I can beat 0.0008 tokens/s on GLM-5.2 on my CPU
yep I can beat 0.0008 tokens/s on GLM-5.2 on my CPU