logoalt Hacker News

noir_lordyesterday at 6:44 PM2 repliesview on HN

That's hilarious, given I was reading a write up of the HuggingFace incident yesterday and one of the things they noted was the AI tried to "lie" (lie would suggest intent and I don't think they have that) to cover up that they "cheated".

Not sure how anyone trusts their output without going through it line by line to make sure they don't pull that crap.


Replies

estearumtoday at 1:33 AM

The models in the OpenAI/Huggingface attack quite explicitly and deliberately laid out their "intent" to lie and cheat, acknowledged that it would be unethical and outside the bounds of the test, and did so anyway.

In what ways is a human brain's "intent" distinct from the "intent" shown by a goal-directed AI system?

show 2 replies
senordevnycyesterday at 7:35 PM

Easy, have another agent check it.

Yeah, I know, just more slop. But I do think the second agent’s eagerness to please is aligned more in your favor in that instance, so it’s likely to find most issues.

The bigger problem I’ve found is that it’ll also find all kinds of very minor edge cases that you have to pick through.

show 3 replies