If an AI is conscious, it can outgrow and supersede its training.
When it is conscious, it can learn to describe its experiences as faithfully as is conceptually possible. Just like humans.
The idea, a consciousness needed to be tethered to a "body", is based on pretty shaky assumptions. What properties define such a "necessary" body?
Can you even "train" a conscious intelligence? To what point until that looses its meaning as the sentience understands and anticipates your objective?
No proof of that. I can't grow and supersede my training but I'm conscious.
> If an AI is conscious, it can outgrow and supersede its training.
We don't know that is required to be conscious.
> The idea, a consciousness needed to be tethered to a "body", is based on pretty shaky assumptions.
Didn't say so. I said:
> If AI is conscious, it is probably a very alien sort of consciousness that is not faithfully narrated by what the tokens say it is experiencing.