The issue is that people form opinions based on what LLMs spit out, they think it's "as good as google", and that google was "as good as encyclopedias" and encyclopaedias were "as good as fact"..

Totally forgetting that the accuracy goes down with each of those evolutions.

I'm also reminded of that "You are not immune to propaganda" mantra, in that, the most likely to be swayed by LLMs are those that believe that they understand that they're inaccurate and sometimes dangerous.

Case in point: myself, today, when claude accidentally ran `rm -fr $variableThatDoesntExist/*` and wiped a server of mine.

The variable was one it had set itself (or had assumed).

At some point as these LLMs get better and better we have to take a step back and remind ourselves that: despite the fact that they can be very persuasive and they can earn trust by being mostly correct: they're still capable of great harm (perhaps much greater harm) because they are dangerously wrong sometimes..

.. and worse, they are controlled by corporate interests.