It isn't always just phone. If you are in a "bad" state, you'll find something else to ease it. And it's often hardly more productive than doomscrolling: just brooding, switching between activities rapidly, or drowsing.
But phone is still the worst offender, of course. It doesn't just steal time and energy, it also reinforces its usage by producing more anxiety