logoalt Hacker News

rhubarbtreeyesterday at 12:37 PM6 repliesview on HN

Here's a trippy idea I have about consciousness, which arose from thinking about recent AI advances and also watching kids develop.

I think children's main "cost function" is the ability to predict the future. This might start out, for example, as being - how will this vertical line move as I move my head. Later, where is the ball going. And they are essentially building a "world model" in their brains, starting with the very simple like this and recursively building more complex predictors. When they predict correctly, happy feedback reinforces the connections that are firing, when they are wrong, they weaken. Just a really simple feedback algorithm that is super robust.

So the brain is building this world model, and it's essentially gradually compressing a description of the environment into a structure made of neurons. And this is the ultimate survival tactic: model the environment explicitly in your head, then adapt your behaviour to fit it. The better you are adapating to future states (dodging that tree as you run) the better survival chance you have.

At some point (complete speculation) we then begin to do something quite strange: we develop a world model _of ourselves_. We get to a level of sophistication where we begin to predict the future states of our own brains. This might emerge naturally as a way to compress existing learnt behaviour. For example, we re-learn to follow lines in a smarter way, particularly as other parts of the brain learn useful things that we can re-use in our line following. This treats our existing model as a cost function, and we learn a model of the model. But it eventually starts to model the higher-level models the brain has, higher up the abstraction stack.

And somehow, the modelling of our brain function creates a chaotic feedback loop that leads to the sensation of consciousness. It's super handwavey, I know, but somehow this recursion feeds awareness. It's like the abilty to see yourself thinking. Consider meditating and the way words appear in consciousness... you get to a point where you can observe what you're going to say before you say them, and I conjecture that is the modelling of the model that's going on.

And this is useful for survival, as you can optimise the way you think, compressing your circuits further, but also has this weird side-effect of creating awareness.

It also explains why consciousness takes time to develop - because you need to develop a model of yourself, but before that you need a model of the world.


Replies

pardon_meyesterday at 8:17 PM

Considering the brain functioning as prediction machine, we are constantly correcting the error between sensory perception and our inner reality. This is classic (closed) control loop[1] with self-correcting characteristics updated by adaptation through learning and experience.

At first the process is subconscious, then chaos enters as our conscious awareness develops, morphing the control loop into second or third order states of "correcting corrections" as we perform inner tasks such as ruminating, or external tasks such as group discussion and logical planning.

The perfect prediction machine would be a simulation running an entire up-to-date universe model, but between our limited physical resources and available energy in reality, our evolved aim is efficiency, by creating a state of awareness and reactive patterns with minimal information (lowest entropy). We do this by making assumptions, testing the world, then processing the response and updating our control loop. The tradeoff is lack of precision, as a model without complete information has guaranteed errors.

Children who form a more realistic core worldview through guidance, opportunities and experience are best set up to create solid foundations which are more adaptable to future unexpected situations. Whether this is learning emotional response in social settings or math, the ability to integrate future conscious experience depends on early neuronal structures formed by subconscious expectations of the world. If measurement error is too great from expectations and our current loop/wavelength, our options are to discard this information or learn from it by reflecting on sources of inevitable prediction error through reasoning.

[1] https://en.wikipedia.org/wiki/Control_loop

lanstinyesterday at 3:24 PM

This theory maps very well onto (at least some parts of) modern neuroscience; how emotions are made is taking this model, that the brains MO is predicting how the body will need to be tuned in the near future, as a way to explain how emotions arise and are perceived. “How Emotions are Made” by LisaFeldman Barrett.

mmnfrdmcxyesterday at 8:34 PM

you might enjoy the first chapter of Diaspora by Greg Egan

https://www.gregegan.net/DIASPORA/01/Orphanogenesis.html

svntyesterday at 12:50 PM

This is essentially where the field is going, started with predictive processing by Friston with his free energy principle, combined into Hofstadter’s “I am a strange loop” and then the continuing thrust with applying the FEP as well as Rosenthal’s higher order theories and Graziano’s attention schema theory.