alt Hacker News> but as Wired notes, it relies on "automated tools" as part of the process, which may have been how the more than 50 ads TTP discovered made it through.
Again, and again, and again, these technologies have proven ineffective to moderate content. User posted and otherwise. Until we have a legal mechanism in place to hold these companies meaningfully liable for this, it will not stop.
Every single one of these has the same damn list of excuses about cost of hiring human moderators, but I promise everyone reading this if you make the executives of a social network legally liable for distributing CSAM on their platforms, they will find all kinds of money to get human moderators really fucking quick.
Replies
I think people have been demanding this for ages but lobbying by social media companies against any change in the law is enormous.
As for the cost of content moderation, Meta has zero interest in any type of moderation to begin with. The cost is just a public-facing excuse. In Careless People, Wynn-Williams mentions that Facebook didn't do anything to stop anti rohingya posts in Myanmar because they did not have any fact checkers who could read Burmese. In other words, they did not have a single moderator in the damn country.
More specifically, these were for ads. They received compensation to distribute this matierial.
FB might or might not have a right to exist in someone's eyes, but the question remains: is 0.5c-like latency messaging across the world acceptable? Because facebook or not, given internets this is what you will end up with. People are people.
On the other hand, now try to ban that telecom. Gods will laugh.
Yeah and/but also the case it's not bidirectional enough
The eternal question of tech platforms - should we be responsible for what users post? (Ads are not user posted, so we can eliminated that factor. Even if posted by 'users' it's a separate pipeline) But with companies like Meta it doesn't even have to go that far - the philosophical conversation - because it's so hostile to users. People get banned for mild things all the time (apparently extra the case, since the 'pivot' to AI) while the absolutely horrible things you report never get taken down
But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful.
---
This is sarcasm, by the way. Most decent people make sure what they're about to do won't harm other people and if would cause harm they wouldn't do it. But social media companies and ad networks aren't run by decent people. They're run by people who believe their business is entitled to infinite scale regardless of how many people are harmed along the way.
We used to say computers can't make decisions because they can't meaningfully be held responsible for those decisions. Now the vibe seems to be that computers should make decisions because instead of anyone being held responsible we can just say "the computer made a mistake and it is very sorry" and effectively shield anyone from being responsible. But the thing is, machines don't do stuff. Not from a responsibility standpoint. My car doesn't drive, I do. It may provide the means, but I decide where we're going and how we're going there. Even with the active cruise on, the car didn't speed, I did. The car may have hit the wall, but I caused the accident. the car ran that person over, but I killed someone, not the car. The machine did what someone told it to do. If someone told it to do a bad thing, or someone did a bad job telling it not to a bad thing, that person is responsible.
When people started using Grok to make CSAM the platform's response was to paywall image generation. If we don't start making the driver responsible for what the car does, the coder responsible for what the code does, the CEO responsible for what the company does, they will continue to exploit people in increasingly horiffic ways.
The article also mentions that a ton of even worse ads were posted between when they contacted Meta and when they were ready to go live with the article, and some of the offending ads which were taken down had just been re-uploaded again and automatically approved.
Not only are their AI tools ineffective at what they claim they should be doing, they can't even be bothered to prevent removed ads from being re-uploaded later on.