logoalt Hacker News

LelouBil • today at 3:03 PM • 5 replies • view on HN

I only saw pangram being mentioned on HN. How good is it in general ? And what do they use to check if a text is AI Generated, the text watermarks from big models ?


Replies

persedes • today at 3:37 PM

it is very good, but keep in mind it'll also flag text edited with grammarly. Maybe not the same as copy and dumping a claude response, but still normalizes the authors voice with AI.

maeln • today at 4:58 PM

In my experience, it can have significant false positive. It's pretty good at telling you when something is NOT written by an LLM, but when it says something is, I take it with a big grain of salt.

hmokiguess • today at 3:16 PM

I hadn't heard of it before, just now looking them up.

Dumb question, but could you pair AI with pangram to make it sound less like AI or would that be a recursive loop? I'm skeptical about it

➕ show 3 replies
Catloafdev • today at 3:56 PM

They trained a model to detect AI-written text.

It works fine on mainstream models where the output hasn't been edited.

It doesn't work on humanizers or custom model output.