The equation is not simply "exercise" -> "live longer" via some unknown correlation.
Exercise increases cardiovascular health, mental well-being, etc. It should be pretty obvious that someone with less risk of heart failure will live longer on average (considering the #1 cause of death in the US...) I don't think you need to factor for every possible life circumstance to deduce that known-healthy activities improve longevity