logoalt Hacker News

logged4upvotingtoday at 3:00 PM0 repliesview on HN

That is not true, over an extended task that you cannot keep complete in memory humans do not behave with 100% consistency.

I have labeled datasets with a human team and shown the same task to the same user on a different day, and they answered differently. Of course, they are usually consistent with themselves most of the time but not always.