logoalt Hacker News

Robdel12 • today at 9:21 PM • 2 replies • view on HN

> As our monorepo grows, it increasingly doesn’t fit that design space. The history of our main branch alone is almost 100 GB, and a compressed working copy is over 25 GB. We perform on the order of 25 million code checkouts per day for CI, before counting developer environments, agent sandboxes, and research jobs. Fetched naively, that would be over 600 PB of git traffic per day.

I read this and wonder what their agents have committed into the repo that people aren't looking at for _that much size_? Do they have a ton of binary assets in there or something??


Replies

nickg-anthropic • today at 10:14 PM

We have a fairly low maximum file size limit in our repo and I aggressively pruned all binary content that really wasn't fit for source control since it compresses really poorly and can cause performance problems in git when updating a checkout over many binary file changes.

This is really all just text.

grey-area • today at 9:26 PM

I suppose massive churn in commits would also bloat the history.

Not sure they should be proud of these numbers, they’re a sign of dysfunction.