Is it such a burden to write them a letter stating, "Because you have decided to disable my electronic access, I am notifying you that I withdraw my consent to e-delivery. Please provide me statements and directions to mail you a check for payment." Maybe spend 20-30 min to find the specific laws that give you the right to do that and remind them of their timelines to comply.
Send a letter like that certified. It gets attention, and the time to write and mail a check really isn't, if you batch your bills, more than using an app.
We do have ways to push their inconvenience back on them.
Not everyone has the time and resources to battle their utilities and bank(s). I know it’s important and sustained effort is necessary even if it’s hard, but we are talking about massive populations here and most people simply can’t or won’t fight that battle on their own. Organizing a large pushback is also a huge effort. And at the end of the day, there is an easy solution for folks: buy a “proper” smart phone that “just works” because it solves the problem now.
We’ve gotten to the point where unfortunately it is a luxury to fight for your privacy and consumer rights.
It is great that you have the right in your jurisdiction to do that. Where I am, they just shut off your power if you don't pay.
It's a big and hairy world out there. Having lived on three continents and traveled to some pretty wild places, I always get a kick out of seeing which rights people have and assume that the rest of the world also has.