It's the kind of thing where it's sort of expected that you wouldn't know, right?

I think we don't really understand why deep learning works as well as it does, the thinking around that is, as far as I can tell, mostly a collection of empirical observations.

A fundamental theory of learning that can be used to predict optimal network architectures might enable smaller models that consume less energy.