Meta's GB{2,3}00 Cluster

It seems that Meta didn't mention one aspect of their "next-generation" AI training system: their incompetent web crawler hammers websites while completely ignoring robots.txt. Meta's 57.141.0.0/24 made up about 90% of all requests to my server this past week, and it didn't stop after I blocked it. They continue to make a request every 2 seconds despite me responding with a 403 every time. Truly an engineering marvel that Meta has bestowed upon us.

Is this one of the pilot models they claim R&D tax credits for?

https://news.ycombinator.com/item?id=49921118

Posting this two days before earnings seems to indicate that there is going to be some bad capex news.

Actual title: ”Inside Prometheus: Meta’s Journey to a Gigawatt-Scale Supercluster”

Imagine your job is just replacing millions of Dollars worth of hardware every day. I mean there must be a reason the hold 8 GPUs per rack spare.

shell glob rather than RE? what's the world coming to!