Apparently it's possible to download a whole load of books illegally, but still train AI models on them without those getting pulled after you get found out.

The same reasoning may apply here :P

Trade secrets once made public don't have any legal protection and I haven't signed any contract with anthropic

They published the code on their own, none of that applies.