alt Hacker NewsThey're running like 10 tokens per second, constantly timing out, and launching new products?
How about deploy some inference GPUs first
They're running like 10 tokens per second, constantly timing out, and launching new products?
How about deploy some inference GPUs first