That's the source, but for chemical reactions you also need a sink. For instance gasoline is not usable as an energy source without an oxidant. Take away the oxygen in Earth's atmosphere (an asteroid has no atmosphere at all) and now gasoline has no potential energy available. Asteroids have no available oxidants (regolith was already fully oxidized long ago).