> "We find that agents who choose new experiments at random develop the most informative and predictive theories of the world. "

There's a neat book about this: "Why Greatness Cannot Be Planned (The Myth of the Objective")

https://www.goodreads.com/book/show/25670869-why-greatness-c...

Incidentally, the author works at OpenAI these days.

https://en.wikipedia.org/wiki/Kenneth_Stanley