> That also means if someone steals my phone they get my credit card too.

Which hasn't been an issue since Chip & PIN became required, 22 years ago (at least over here).