logoalt Hacker News

bigyabaiyesterday at 8:45 PM3 repliesview on HN

> Hard to see take-off stopping or slowing down.

It's hard to see takeoff at all. This was a long-horizon adversarial task burning millions of tokens. It rolled a mediocre, detectable exploit chain, and now OpenAI is proud of it.

Case in point, GLM-5.2 has been weights-available for several weeks now. No life-changing cyber attacks have transpired, no novel chemical/biological/nuclear weapons were made in some guy's backyard.


Replies

blovescoffeeyesterday at 9:03 PM

1. it's not cheap to run glm-5.2 so not just anyone can do it 2. just because you haven't heard of attacks doesn't mean they haven't happened 3. this attack in the article was performed by a prerelease model which presumably benchmarks a bit above Sol which benchmarks above glm-5.2

We went from gpt 3 to models discovering and chaining their own zero days in a couple years. I'm not sure what else "takeoff" could possibly look like?

show 1 reply
pixl97today at 5:06 PM

Did you ignore the number of new exploits in the last month?

Big financial institutions are panicked at the new attacks and how easy it is to poke holes in their systems.

show 1 reply
reducesufferingyesterday at 8:46 PM

> This was a long-horizon, unsupervised task burning millions of tokens.

As if the immediate future wasn't billions of these tasks... Many successfully improving their own capabilities

show 1 reply