logoalt Hacker News

usernametaken29 • today at 12:25 PM • 1 reply • view on HN

I find this particularly concerning because in their related works they did not refer to the free energy principle, which is the underlying principle of energy based cognition... so eh... what are they referring to? If its not the energy as defined by FEP and active inference, which energy is it? Did they mean entropy? I didn't get it from the paper, really


Replies

eli_gottlieb • today at 4:32 PM

Energy-based models parameterize energy functions $$E_{\eta}(x) = -log p_{\eta}(x)$$ with neural networks $$\eta$$. The FEP and active inference are specializations of this paradigm to latent-variable models where the energy function is defined by the unnormalized Bayesian posterior over the latent instead of just a marginal distribution over the observed data.

Source: I've worked with a lot of core FEP folks and published at their conference.