I read that on Apple if you download and install a weather app, every week it'll ask you if you're sure you want that app to know your location.

There's no happy middle ground. You'll always have to be careful what you install.