logoalt Hacker News

flextherulertoday at 4:06 PM1 replyview on HN

I've started looking at profiles of the non-technical "AI at any cost" people on Reddit and noticed a trend towards AI generated NSFW posts and anime. Unsurprisingly they tend to have zero tolerance towards accepting legitimate criticisms or concerns. After reading about the blackmail a school system in the UK faced because criminals took a public post of 10 year old soccer players and generated sexual child abuse materials with the real girls faces it's in everyones best interests to not post their children's images until or unless we can regulate this behavior.

https://www.malwarebytes.com/blog/family-and-parenting/2026/...

"By November 2025, IWF reports of AI-generated CSAM had more than doubled year over year, rising from 199 to 426. Girls accounted for 94% of the victims. Reported cases included children ranging from newborns to two-year-olds, according to the organization.

The ecosystem around these tools is industrial. In April 2025, a researcher found an exposed AWS S3 bucket belonging to South Korean “nudify” app GenNomis containing 93,485 AI-generated images alongside the prompts that produced them."


Replies

0cf8612b2e1etoday at 4:50 PM

What more regulation needs to happen? Real or synthetic CSAM is already illegal. Adding another law that is effectively, “Same thing as the previous ones, but this time the generator is a LLM, not Photoshop”.

show 1 reply