> We’re already ripping the spines out of old rare paper books (we playfully call these “low-background steel”)
can someone closer to pretraining elaborate?
https://en.wikipedia.org/wiki/Low-background_steel
Replace "nuclear explosion" with "AI produced works"
In this context it means "text written before the advent of AI slop, so we know it at least came from humans and wasn't influenced by AI slop".
Not at all close, but this link might give you more to go on (includes more links):
https://www.snopes.com/fact-check/ai-companies-destroying-ra...
More here: https://en.wikipedia.org/wiki/Project_Panama