logoalt Hacker News

shafyytoday at 8:42 AM4 repliesview on HN

Can it? I feel like I instantly recognize if I am chatting with an LLM or a human


Replies

coldteatoday at 11:18 AM

"Feel" is doing a lot of work here.

You can recognize 70% of those (true positive rate) and still have a false negative rate of 30%, while thinking you got 100% of the AI ones!

The problem is that you'd be oblivious to those you don't recognize.

piva00today at 9:00 AM

I was quite surprised on how difficult it is to tell when chatting with an uncensored LLM a friend is running (it's too big to run on any of my computers but he got some B200s). You can input your own "system prompt" to make it behave like a normal internet user and the prose writes very similarly to internet comments with none of the LLMisms from ChatGPT, Claude, Grok, etc.

IMTDbtoday at 8:59 AM

Emphasis on "feel"

taplandtoday at 8:55 AM

Can't even tell if you're real or a bot by reading one comment.

Great times!