logoalt Hacker News

eutropia • yesterday at 7:05 PM • 4 replies • view on HN

This is a positive development. People working for the NCMEC have had to deal with an insane increase in CSAM content (like upwards of 1,000% increase in 2025 alone) due to diffusion models dramatically multiplying the supply of CSAM.

When there's an active and urgent case to try and locate and rescue children in these situations, the volume of AI-generated content makes it that much harder to perform forensic investigations on background materials (often how they locate children being abused is by prosaic items like electrical outlets, household goods, etc. in the background of abuse photos and videos) because now they have to rule out whether an image is even real -- a task that often requires close attention and scrutiny to details of traumatizing and disturbing content (sometimes all the more traumatizing due to the 'creative freedom' of AI-generated material)

A model capable of shielding investigators from additional trauma is an excellent thing.


Replies

torginus • yesterday at 9:59 PM

CSAM stands for Child Sexual Abuse Material. Using diffusion models to create naked pics is by any reasonable definition not CSAM since no child is being abused. It's baffling to me that I have to state this, since it's tautological. The reason why child pornography is treated like a horrific crime by all of society, is because it harms actual children - this used to be the actual legal criteria for it.. Extending the reach of the crime to something that has none of that impact seems like a transparent power grab.

Just to counter any obvious moralizing, I am not saying using models like that is okay, but it's an entirely different kind of crime.

➕ show 2 replies
paulryanrogers • yesterday at 7:11 PM

> diffusion models dramatically multiplying the supply of CSAM.

Isn't CSAM only material based on abuse of real humans? How could computer models multiply CSAM by that definition?

➕ show 6 replies
kikdij • yesterday at 10:13 PM

They probably use "uncensored" local models, though. I doubt commercial models could ever be used for that.

sebzim4500 • yesterday at 9:35 PM

If victimless AI child porn is flooding the market and making it harder/impossible to monetise actual CP then isn't that a massive positive?

➕ show 2 replies