there was a post recently on a guy that was posting fake stats in order to prove that llms can be tricked

similarly OpenAI was born out of the idea that the tech will exist and that they should be the oned to decide how it exists instead of other bad guys

I think if you do something you did it, imagining another bad guy doing it is not a great defense.