logoalt Hacker News

tintortoday at 12:59 AM1 replyview on HN

Does your server have 20Tbyte+ of storage for frontier LLM weights?

It is too large to transfer in one HTTPS PUT request.

This needs to be S3 object store with multi-part upload spanning a long time period, to avoid trigger outgoing bandwidth monitors.


Replies

taylorfinleytoday at 1:45 AM

It goes to r2 and supports multi-part with 5 tib chunks

show 1 reply