this is what worries me. I have friends that love what AI tells them about their personal pet 'thing' and how awesome it is. Yet not one of them has even tried once to get the AI to criticise it's own answers, and hence learn that you can trivially get an AI to make a convincing-_sounding case for any point of view.

I tell them to try, and they laugh at me as they roll their eyes and waffle on about 'tricking' the AI like its some kind of hacking.