logoalt Hacker News

kerkeslagertoday at 10:52 AM0 repliesview on HN

The problem with AI is deeper than this, though. The anchoring effect[1] is stronger than most people realize. It's hubris to think that you can read AI output and then come up with your own ideas. The human brain simply doesn't work that way. We anchor to the first idea we come across, and it immediately becomes difficult to change our minds.

The effect of this over time is cumulative. Cervantes said (in translation), "Show me who you spend time with, and I'll show you who you are." I realized as a teenager that the books I was reading and people I was listening to were shaping my ideologies in ways that were outside my control. It's prohibitively difficult to pause when presented with every idea and analyze it to see whether it makes sense. If you're cautious you'll catch some ideas and analyze them, but a lot of the time, you won't even consciously recognize that you've been presented with a new idea, and you'll simply integrate it unconsciously. Time passes and it becomes difficult to remember where our ideas came from or why we thought they were true.

This was a problem before AI: if you surrounded yourself with people who thought poorly, you thought poorly. Now with AI, millions of people have let a "thinker" into their lives which has massive information and no wisdom.

Frankly, when I find out someone uses AI in any way, I lose respect for them. The best case scenario is they use it similarly to the post I'm responding to, filtering the ideas they get from AI through their own intelligence. But that doesn't really work==original thought it harder than that. And that's the best case scenario--most AI users don't have anywhere near the discipline for that, and just regurgitate what AI tells them.

Rewording it doesn't help--it's still not your idea, from your experience and logic. And once you use AI at all, it's very hard not to be just rewording.

[1] https://en.wikipedia.org/wiki/Anchoring_effect