logoalt Hacker News

cousin_it • yesterday at 1:30 PM • 1 reply • view on HN

The article makes claims about the future, such as:

> We cannot make an AI that improves software coherence beyond the human ceiling without leaving the bubble

That's what I was replying to.


Replies

dwoldrich • yesterday at 5:29 PM

There are deeper challenges implied in that statement, though.

Where does the agency for an AI to leave the bubble come from? And when it does leave the bubble, where should it go for researching an expanding, exponentially complex problem space? Creativity is needed to solve some problems, something that cannot be infinitely encoded with statistics.

And what about the irreducible complexity problem? Does an AI just circle the solution drain forever in the case it lacks agency and insight and curiosity enough to collect all the correct requirements? Can we code curiosity that actually functions, a.k.a. consciousness?

Do you believe human consciousness could be reducible to program statements and serve as a useful model? Is consciousness a mechanistic, wholly internal process that occurs in our bodies or is it something experienced that life on earth is exposed to and somehow "taps into"?

➕ show 1 reply