alt Hacker NewsWhat does it say about me that when I run my writing through one of those "detect if AI" tools I seldom see a value of less than 70% confidence that the writing was AI generated?
Replies
AI detectors don't work.
What it says (and this fact is not popular around here) is that you write better than the average person.
have you tried pangram? it's basically the only good AI detector, and they have nearly 0 false positives
Simple: The derived variance in your word usage and sequences, is outside the mean distribution range, that would be labeled as AI generated, given this specific evaluation algorithm
It’s not nondeterministic
you can probably do the shannon entropy calculation yourself if you understand what the evaluation algorithm is
That said…if the evaluator is non-deterministic, then there’s no value in the estimate anyway
It probably means that your writing stylistically is close to the vector-space average of "good" writing, which is what AI produces.
FWIW, your comment history here does not look like AI at all to me, and I think I have a very (maybe too?) high sensitivity to AI slop.
try it with something published before 2022. do you still get the same results?
I really doubt those tools are good for anything
about you? not much. but i wouldnt spin up a blog, or even longer comments here, if you want to keep your sanity.
the amount of "that is obvious ai slop" comments i see on mine or other people's genuine non-ai writing has discouraged me from sharing anything more than roughly a paragraph for probably the rest of my life.
I know this is a spicy take, but it probably just means you're more eloquent in your writing than most netizens...
And that's not really a hard bar to clear if you look at how people write comments online (including places like GitHub).
Anyone that uses punctuation, and capitalises words, probably automatically gets past the 70% confidence line.