> tax returns seem like an obvious alternative and they are already private and collected at a much more granular level.

Plenty of people don’t file tax returns (legally even, there’s a minimum income threshold).