When you say enforcement isn't worth it, you end up letting the most inconsiderate people with some of the worst decision making set the tone for society.
It's also pretty likely that the state violence will be a threat rather than a literal pistol whipping. Harder for the vigilante to make that work.