logoalt Hacker News

arjieyesterday at 10:08 PM1 replyview on HN

Fascinating. It's a classic paperclip maximizer situation: under-aligned AI uses ion-cannon to unwrap chocolate bar. I'm both surprised this hasn't already happened and impressed by the capabilities here. Coming up with a 0-day to do this is outrageous.

A silly related story is that I run `claude` with full permissions but the prod DB passwords are in a different environment and it has read-only with granular security. One time I hadn't yet granted it access to some column, and it figured out it could `kubectl` with the appropriate context to go fetch it from prod. Now that was a rapid Esc Esc Esc :)

This was Jan so an earlier Opus.


Replies

pixl97today at 1:01 AM

I mean we already see these things exploit configuration errors on people's machines to get root unexpectedly. They are really damned good at finding security flaws (and I'm assuming nation states are pushing the companies to increase these capabilities). Then half of HN seems surprised the parrot can hack better than they can.