logoalt Hacker News

delichonyesterday at 7:44 PM6 repliesview on HN

The moderators are supposed to just know it when they see it? It's that black and white to you? Or are lots of false positives a price we have to pay?


Replies

andaiyesterday at 8:04 PM

Yeah it's weird, there was one case where I thought it was AI but wasn't sure. Several other comments pointed it out, too. Author claimed he wrote it manually. (Which is honestly even more concerning!)

Maybe there can be a dedicated 'flag botspam' button?

Then again it's a nuanced issue. I see AI used in a large percentage of writing now, so would this rule apply to the article as well?

show 3 replies
lokaryesterday at 7:49 PM

It’s only going to get harder has people continue to model their writing on LLM style.

show 2 replies
shimmanyesterday at 8:34 PM

Something we need to remember that AI was trained on every public internet comment, the vast majority of which are legit terrible. The biggest tell that someone is using AI is having multiple paragraphs saying the same point over and over again. Even trolls are more succinct.

show 2 replies
zahlmanyesterday at 10:05 PM

In some fraction of cases, it's really obvious.

I would argue that those cases are really the ones that cause an LLM-specific harm, i.e., which make people feel like they aren't exclusively among fellow humans.

If someone posts something that doesn't clearly read LLM-ish, but is otherwise terrible, it's not really different from if the same terrible thing had been written by hand.

I don't think anyone who objects to LLM comments is really demanding a super-low false negative rate. Just get rid of the zero-effort stuff. For example, recently I've seen a lot of comments from new accounts that are just sycophantic towards TFA and try to highlight / summarize a specific idea or two, but don't really demonstrate any original thought (just, like, basic reading comprehension and an ability to express agreement). And they'll take a paragraph to do so, where a human with the same level of interest in the material might just say "good post" (granted, there's an argument to be made for excluding that, too).

BalinKingyesterday at 8:15 PM

Sorry, updated my original comment—I meant to qualify it to only those cases where it's blatantly obvious. Obviously a lot of ambiguous comments will slip through as a result, but I agree with you that false negatives are better than false positives.

show 2 replies
Gabrys1yesterday at 8:02 PM

Can use AI to detect that