alt Hacker NewsI am confused what people even think AI is experiencing. If it claims to be a bat and emits designated echolocation tokens, is it experiencing true bat-like sensations?
In humans, at least, we can tie language back to shared whole-body physiological responses. The tokens from an LLM do not represent anything of the sort.
If AI is conscious, it is probably a very alien sort of consciousness that is not faithfully narrated by what the tokens say it is experiencing. It can be trained to say it feels like a bat and insist upon it vigorously.
Replies
> It can be trained to say it feels like a bat and insist upon it vigorously.
So can you.
If an AI is conscious, it can outgrow and supersede its training.
When it is conscious, it can learn to describe its experiences as faithfully as is conceptually possible. Just like humans.
The idea, a consciousness needed to be tethered to a "body", is based on pretty shaky assumptions. What properties define such a "necessary" body?
Can you even "train" a conscious intelligence? To what point until that looses its meaning as the sentience understands and anticipates your objective?
> very alien sort of consciousness that is not faithfully narrated by what the tokens say it is experiencing.
IIRC it's been shown that reasoning tokens don't actually explain what an AI thinks and you can replace most of them with dummy tokens or even nonsense tokens. That's one reason they're trying to make them reason with activation vectors instead.