Actually useful AR needs cameras, of course, so the technology has legitimate use cases, but you'd have to be a real asshole to wear them to a bar, or a restaurant, etc. Maybe we mandate that the glasses have to have a base station dongle, and if they're more than 10 feet from the dongle, recording doesn't work without incredibly obvious annoying lights indicating that recording is on?
A cultural convention that lets people make honest mistakes, but turn it off when someone says "hey, you're recording" seems like a good solution. Just need to make it easily visible and obvious to others - you can run around in public with a big news camera on your shoulder or a tripod and you usually won't get hassled. It's just the idea of being covertly recorded, even while in public, that gets creepy.
Maybe if we weigh legitimate use cases against privacy and end up deciding that the privacy is more important, then we just don't accept those use cases? That is: we invent new awesome life-changing technology and we just... don't use it?
Like we could have navigational AR-glasses. The wearer sees arrows on the floor where to walk. And we could choose to not let anyone wear them in public even though what they do is useful, and there aren't any real privacy issues. But people around the wearer don't know that. That's the privacy concern.