logoalt Hacker News

plaidfujitoday at 1:05 AM1 replyview on HN

To put that in perspective, if you assume a token is 4 bytes, that’s about 164 MB/s of traffic, which sounds a bit less staggering.


Replies

dnnddidiejtoday at 1:27 AM

Dealing with a lot of traffic for a small team isn't hard in itself. If it is easy to parallelise you just need to horizontally scale. And most concerns can be added as sidecars or middleware. Rate limits, auth, etc. Basically this is a kubernetes cluster. For a 3 person startup hard. For 50 pretty managable.