Even with actual asbestos, the risk goes up a lot with duration and intensity of exposure. Probably, the risks of getting cancer from a brief exposure is fairly low, and combined with the ridiculously small sample size of only 12 people to ever set foot on the moon, it's natural that none of them got "moon cancer". That said, with asbesto, it's still possible to get cancer even from brief exposures:
> Although it is clear that the health risks from asbestos exposure increase with heavier exposure and longer exposure time, investigators have found asbestos-related diseases in individuals with only brief exposures. Generally, those who develop asbestos-related diseases show no signs of illness for a long time after exposure. It can take from 10 to 40 years or more for symptoms of an asbestos-related condition to appear. [1]
[1] https://www.cancer.gov/about-cancer/causes-prevention/risk/s...