I only saw pangram being mentioned on HN. How good is it in general ? And what do they use to check if a text is AI Generated, the text watermarks from big models ?
In my experience, it can have significant false positive. It's pretty good at telling you when something is NOT written by an LLM, but when it says something is, I take it with a big grain of salt.
I hadn't heard of it before, just now looking them up.
Dumb question, but could you pair AI with pangram to make it sound less like AI or would that be a recursive loop? I'm skeptical about it
They trained a model to detect AI-written text.
It works fine on mainstream models where the output hasn't been edited.
It doesn't work on humanizers or custom model output.
it is very good, but keep in mind it'll also flag text edited with grammarly. Maybe not the same as copy and dumping a claude response, but still normalizes the authors voice with AI.