For me it's not about the capabilities but what they can be used for. Think of all the recent drama between Anthropic and the Department of War. A real wake up call (especially if you are not a US citizen). Proves that AI is essentially a Surveillance and Warfare technology (which justifies the big valuations).

Or see this simple and fun site: https://hn-wrapped.kadoa.com

AI automatically analyzes all your social media posts in your life and can generate a pretty accurate profile about you in a second. We have no privacy anymore. Social media sites like Reddit already do that for moderation. Others do for more sinister reasons.

Note that Profiling is illegal in many countries. But laws can't protect us anymore.

Yes, it was always possible to that manually. But with AI it's so easy, fast and accurate to do in large scales. A hacker having access to your computer, reading your mails and messages is one thing. An AI reading and analyzing all your mails, messages and data is something different. Doing this for whole demographics (Cambridge Analytica style) is at another level.