We are treating AGI like is something that we can measure. We don't even know what intelligence really is let alone measure it.
Maybe we can get something that resembles intelligence but in reality is another thing. Maybe intelligence is emergent but not the only thing that can emerge, maybe there are things that share some characteristics with the intelligence we know and aren't intelligence.
>We are treating AGI like is something that we can measure. We don't even know what intelligence really is let alone measure it.
Here's a nice test: Can an AI fully substitute you?
I don't mean replacing you at your job. I mean, if you take a human body and route its higher brain function to an AI, would it be able to perform convincingly?
I would say currently we're very far from such a scenario.
When I consider the option to buy a shirt, the problem is considered in a large amount of dimensions intuitively (is it warm enough, does it fit, does it clash with my wardrobe, will my girlfriend like it, will my friends laugh at me for wearing it, does it make me look older, is it a good price, are sales happening soon, is it annoying to clean, can I afford it, will carrying a bag with the purchase annoy me for the rest of the day).
Currently AI can offer good answers for any of those dimensions if explicitly asked, but it is pretty bad at the "intuitive creativity" of surfacing those points of consideration when relevant. It will at most chose a couple of criteria and fixate on them.
I think this ability, however it's defined, is a missing prerequisite for AGI. Without it, you can have something that outperforms humans at every individual task and still sucks in real world decision making.
100%. And It’s pure hubris to pretend that “intelligence”, especially of the general kind will be reached with language alone.
People need to start measuring threats by skill level. Agi is already superior to me at code and architecture. Its skill set surpasses me. It doesn’t do everything I do but its skill set includes the hardest stuff.
A 12 year girl from a third world country with little education and a normal cloud ai would far surpass me at work if I did not have access to AI, yet comes close if we both had it. AGI already passed a few months ago. SI or happy ai or whatever the us wants to call it may or may not come but if it does it’s skill set may drown out my understanding of what is even occurring.
It seems the current definition of agi as per the frontier labs is throwing thousands of agents on problems with fast verifiable solutions and hoping for the best.
I'm not even sure intelligence is the issue. Is something that looks and behaves like intelligence intelligent? Sure, why not? What's the big deal?
I think what's really underlying the "fear of calling something intelligent" we have, is more about who we are as a species.
We historically used intelligence as a yardstick for racial and species superiority. We're always judging whether something or someone deserves respect, deserves consideration. We judge and decide who is superior.
We do it amongst ourselves so of we are projecting that shit onto AI now. And we are afraid of anything that threatens the superiority complex we have as a species.
Why? Because our behaviours (call it intelligence, whatever) is how we survived, how we "won" in the fight against nature. We're at the top now. It's safe here.
So anything that threatens that position is going to be called an enemy because we're still a scared creature jumping at shadows in caves. Can't escape that, it's where we are from.
That's why we are both so fascinated by, and mortally afraid of, something else having "intelligence". It's our only weapon, our only defence.
The TV show "Humans" from ages ago made a good story about what AI brings out in us as a species. We both crave connection with something, but at the same time are horrified and incredibly afraid.
Anyway my point is I think we do know what intelligence is, if we just start being brutally honest with ourselves. It's not that complicated really.