alt Hacker NewsPart of the problem is also then the indiscriminate hoovering of any and all data by LLMs. If they kept their own trusted data sources instead of stealing from anyone and everything, then poisoned data wouldn't be an issue. The data poisoners are at fault, but so are the LLMs trusting anything and the companies thievery of human labor. Once the LLMs bring up this data, it's now on Anthropic and OpenAI for editorializing and saying "this is true".
Except for the fine print. LLMs are to be used for entertainment purposes. lol
> If they kept their own trusted data sources instead of stealing from anyone and everything, then poisoned data wouldn't be an issue.
If they didn't, they'd be unable to compete with their competition and also we'd get worse models that can't reason about many domains or do that much due to limited training data/generalization. I don't think we can put the cat back in the bag or mandate only non-problematic training codebases without shooting ourselves in the foot.
Now, if those AI orgs were mandated to properly compensate everyone whose data they've mined, to track which neurons get invoked and to pay accordingly based on what was used to train them... ehh, that's about as unrealistic as stopping. Kind of a bad situation all around, unless you abandon the idea of any sort of copyright.