Yeah. Did you see article that they made a brain organoid (actual brain neurons on a chip) play DOOM?. What are those neurons experiencing?
> What are those neurons experiencing?
Doom. (Obviously.)
I hadn't until you mentioned it but now I have! I expect one day they'll generate a language model on one and then we can just ask it, assuming they don't give it a special rule about never describing its experiences.
> What are those neurons experiencing?
A reasonable explanation is that a few neurons probably don't have conscience so they can't really experience anything.