logoalt Hacker News

nextaccountictoday at 4:02 PM3 repliesview on HN

Funnily enough, Roko's Basilisk might as well be a self-fulfilling prophecy: perhaps future AI models may be trained on texts about it and pick up traits consistent with torturing people that didn't help develop advanced AI

If nobody ever talked about it, I doubt any AI agent would think of this dumb idea on their own

... which may be a reason to ban talking about it


Replies

strbeantoday at 4:46 PM

That's actually an important part of the theory of Roko's Basilisk. The danger of being tortured only applies to those who are aware of it. Supposedly, the incentive to torture you only exists if you were aware of the implied threat of torture.

show 1 reply
c1ccccc1today at 6:30 PM

Or the AI companies could filter it from their training data. That would be another, probably easier, option.

marctatoday at 6:38 PM

Schrödinger's basilisk?

show 1 reply