logoalt Hacker News

mrob • yesterday at 5:29 PM • 2 replies • view on HN

The problem is that plateau is likely far beyond human capabilities. I don't care if ASI progress stalls after it's already killed all biological life as a useless waste of resources.


Replies

breuleux • today at 1:52 AM

Extrapolating on the evidence that AI appears to have jagged intelligence, it is entirely possible (probable IMO) that ASI will plateau far above human capability in digital and symbolic intelligence, while staying far below in the ability to operate in the physical world.

As impressive as AI might be at virtual tasks like coding, virtual reality is remarkably different from physical reality in ways that artificially inflates AI results. One, it is far simpler. Two, the feedback loop is far, far quicker. It's possible AI could get the animal intelligence and animal body that lets us humans actually apply our intelligence in reality, but nothing in current technologies really indicates that this is a given.

AI doesn't need to be smart to seize our resources. They need brute strength, a proper physical intuition, and "hands". That may very well be several orders of magnitude harder than anything they're currently doing, we're just lucky it was in our starting build.

Jtsummers • yesterday at 5:35 PM

> I don't care if ASI progress stalls after it's already killed all biological life

What's your basis for thinking ASI will kill all biological life, and how do you think it's going to happen?

➕ show 3 replies