Where it gets "you really should care about this" are things like your insurance carrier using this sort of data (which is for sale to all comers) to, say, increase your premiums under the guise of "your 2 Big Mac a week habit makes you a bigger risk".
Insurance is about accurately pricing risk, not subsidizing covert risky behaviors. Why shouldn't they consider your diet?