alt Hacker NewsWhy does this person deserve any kind of support? What’s the point of poisoning LLMs? To put some cursory Luddite roadblock that might delay the technology for a couple of months?
Replies
This is a “if we stopped testing there would be far fewer cases!” mentality...
> What’s the point of poisoning LLMs?
It's a demonstration. If a domain name and a quick bit of Wikipedia vandalism is all it takes to make an LLM start spouting nonsense about a "surprisingly serious tournament circuit" or a "massive online community" for an obscure card game, consider what an unscrupulous PR team or a political operative could do to influence its output on more important topics.
To prove you can. Which means someone else with more to gain from it will probably do it also, and you should probably expect this to happen.
You do know that calling people who don't like AI for any reason Luddites does you no favors, right? It just makes you look like your a part of a cult.
Support? It's just showing weaknesses of LLM's. Which is a valid sort of research I would say?