Because you made a strawman out of their point. Reasonable people avoid drug markets for good reason.

Drug crimes and non-drug crimes (assault, robbery, x/y/z) commonly cluster[1], and citizens with working risk estimation skills move on and cede the space.

[1] https://pmc.ncbi.nlm.nih.gov/articles/PMC2719901/