One might wonder why LLMs were even trained with this information in the first place…
It wouldn’t need guardrails if the people training it had any of their own…
May be they want to sell it to law enforcement as a model that can identify suspicious activities. It needs to know how and why something is suspicious to flag.
or its just lets gobble everything and figure out the guardrails later kind of approach.
The training data is not so specifically filtered at least in pre training. The point is to give them as much world knowledge as possible