logoalt Hacker News

XorNotyesterday at 11:48 PM1 replyview on HN

Except that's for pathetically small datasets.

What real datasets exist where this would be a worthwhile trade off versus simply owning the hardware?

The numbers are so bad that underpowered local hardware would still beat it.


Replies

inigyoutoday at 9:29 AM

yep I can beat 0.0008 tokens/s on GLM-5.2 on my CPU