The difference if you can film out on the street (random people walking by) or just your property (my own fault if I approach your door).

Some countries have laws for this, as in you can only point the camera so that you don't catch everyone. This can have downsides, e.g. if you have no (even short) front yard and your (organization's) door is directly on the curb - but I completely agree that this is just tough luck, the privacy of random people walking on public property past private property should not be filmed.