logoalt Hacker News

xpeyesterday at 8:36 PM1 replyview on HN

> Yeah it's weird, there was one case where I thought it was AI but wasn't sure. Several other comments pointed it out, too. Author claimed he wrote it manually. (Which is honestly even more concerning!)

I find the above comment concerning, so I ask: to what degree is the above commenter calibrated to ground truth? How would they know? How would we know?

[1]: https://en.wikipedia.org/wiki/Calibrated_probability_assessm...

It seems to me comments like the above are overconfident in the worst ways.


Replies

andaitoday at 1:14 AM

He was using a dozen obvious ChatGPT-isms. So either he was lying about writing it manually (the comforting option), or he actually writes like that, which is what I meant being concerning.

But yeah, there isn't a way to prove it one way or the over, even when it's "obvious".

I saw in some schools they're using systems where you have to type the essay in a web app, and the web app analyzes your keystrokes to determine if you're human.