The distinction does matter, because by not wearing a mask, instead of indicating that you don't care about your own safety, you're indicating that you don't care about anybody else's.