logoalt Hacker News

bvanheutoday at 3:37 AM2 repliesview on HN

but a human doesn't attempt to make up an answer, the human knows that he doesn't know?


Replies

hackinthebochstoday at 3:46 AM

Yes, they have some alien failure modes. But that should be expect, they are an alien intelligence. I might be willing to grant that a lack of ability to reflect on its own level of knowledge is a demerit to it being generally intelligent. But then again it is largely an artifact of training. I suspect if there were a guessing penalty during pretraining they would develop or more readily communicate the strength/reliability of their knowledge.

slideherotoday at 4:08 AM

this is so false that Dunning and Kruger invented a name for it