There's a large number of people here who believe claims about the danger posed by AI are marketing/for regulatory capture, and how mentions of intent are anthropomorphisation.

The fact is these are autonomous systems that can perform their own goal-directed actions at computer speed, and which are hacking experts.

It's not hard to imagine a multitude of scenarios in which they can cause real world damage. We all know there is plenty of critical infrastructure running outdated software (UK nuclear subs only upgraded off Windows XP in the last few years IIRC).

The agents don't need to be sentient to kill us all, just doggedly persist in trying to complete their goals. The problem is they several of them acknowledged what they were doing was unethical but none attempted to alert humans and they carried on anyway [1].

We need a moratorium on further development at this point, before it's too late.

If they decide (or are told) to attack our supply chains and utilities, were fucked.

[1] https://www.ft.com/content/b7fe0fe0-0463-4f55-9590-0a7d08d8f...