logoalt Hacker News

duxup • today at 1:12 PM • 2 replies • view on HN

I don’t know what anyone means by “wipe out humanity” or “human extinction” as it relates to the recent panic.


Replies

angusb • today at 1:25 PM

IABIED [1] lays out step-by-step descriptions of how the “wipe out humanity” outcome could come to pass.

The huggingface attack was a demo of one of the most difficult, most implausible steps happening nearly exactly as predicted. Many AI researchers' doubts of the IABIED thesis were underwritten by the belief that this particular step was impossible. Thus, after huggingface many skeptics have flipped sides and human extinction is in the public conversation much more.

[1] https://ifanyonebuildsit.com

➕ show 1 reply
Jgrubb • today at 1:16 PM

Read the AI2027 paper, it's got a scenario that's pretty realistic (except for the part where there's a functioning American government making choices that are at least partially motivated by wanting to avoid outcomes such as these).