alt Hacker NewsThat compression and prediction are deeply connected is obvious from simply considering how compression algorithms work.
Nothing about the concept of "intelligence" is nearly as well defined as the other two, nor as well agreed upon.
That compression and prediction are deeply connected is obvious from simply considering how compression algorithms work.
Nothing about the concept of "intelligence" is nearly as well defined as the other two, nor as well agreed upon.
"Understanding" is clearly linked to compression. Taking observations and coming up with a more compact representation that explains them, analogous to coming up with a compact set of axioms that generate facts, or a small Turing machine or short program that generates a list of strings.
Intelligence is a broader concept but definitely involves understanding how a system/envoronment works and making predictions about its unfolding, especially actionable ones that allow you to steer that state towards some goal states.
These are not new.