logoalt Hacker News

modeless • today at 4:05 AM • 2 replies • view on HN

AI detectors can't work in theory, but Pangram works well in practice. This is because the AI companies are not trying to fool Pangram. They have no incentive to; in fact the incentive goes the opposite way. They want to watermark their outputs to leave no doubt as to whether something was generated by their AI.


Replies

orbital-decay • today at 2:18 PM

AI companies might have no incentive but determined actors do, by definition. Anything Pangram could possibly do (even semantic variation detection) can be trivially bypassed by doing img2img on a custom trained local model, which is in itself done trivially in practice by many people. Same for text, train it on anything and use distribution-aware sampling. From your words, you already have false sense of reliable detection, so a work of a determined actor will trick you into believing false negatives.

eranation • today at 7:36 AM

I was a skeptic. Couldn’t trick pangram yet.

➕ show 3 replies