It still would be toxic to corporate decision makers if they were caught dishonoring this control on one type of an account. If they're willing to lie and cheat on one tier of account, what guarantees they won't lie and cheat on the other tier next quarter. Especially with Anthropic being a public company now, that pressure would certainly be there if their corporate culture were comfortable with this type of fraud.
Such privacy checkboxes always seem to suffer from a string of bugs that causes them to reset to the "suck all my data" option. It's really quite strange.
But didn’t they already train their AI systems by violating copyright, vacuuming up any and all material they could find? Hasn’t that bridge already been crossed?