logoalt Hacker News

nonameiguess • today at 5:26 PM • 0 replies • view on HN

I fear this is the result of a massive disconnect based on what you were told to expect. I read Kurzweil when that first came out, and maybe I'm remembering wrong, but I remember the singularity being the rate of technological progress in all domains will be so fast as to be asymptotic to an infinite slope and anything that will ever be possible will happen more or less instantly. Scott Alexander told me in a comments argument on his blog ten years ago that encryption is pointless because an AI will turn Jupiter into computronium and break it. Zvi was bandying about with the "take over its light cone" and "erase all value from the universe" phrases.

If that's the standard, then sorry, I'm not impressed by proving the Riemann hypothesis. If the standard is rapidly improving software for generating other software (which may or may not itself be any better than existing software) and math proofs (that may or may not have any meaningful real-world impact), then sure, I'm impressed. It doesn't mean I expect the daily lived experience of more than a few hundred thousand people globally to change much in the next decade, and most of the ones whose lives will change are software developers and mathematicians.

On that note, I have to imagine you have something different in mind when you talk about the "original meaning" of superintelligence, as you seem to not be talking about the Kurzweil/Bostrom/Yukowsky type of being effectively indistinguishable from God or at least the ancient alien civilizations from the Space Odyssey or Expanse novels, which again, I'm not seeing much of a hint toward because we have very good automated theorem provers. Proving Riemann doesn't mean we can now figure out zero point energy and turn planets into stars.