Can you elaborate? First, nobody is required to carry around a driver's license; it's only needed for when you drive. And in the cases where you need to show a government ID, a driver's license (assuming it's a REAL ID) is just as good as a passport. So I don't really understand your position.
ICE has proven people's fears about the Federal government compiling databases and using facial recognition systems with handheld readers and massive surveillance networks so they can sic jack-booted thugs on people. It doesn't matter they were "targeting" illegals, every aspect of the fear was proven out in horrible fidelity, and nobody was able to pump the breaks before scores of people were murdered in cold blood. REAL ID isn't strictly necessary for that to happen, but it certainly helps[1], and it moves us in the wrong direction. There's a similar threat from states, but that's a separate problem and doesn't justify letting the Federal government have its way.
Also, they will make it increasingly difficult to move around without a REAL ID. This year I took a flight and forgot my passport. SFO was okay with me boarding without a REAL ID. But SAN (San Diego) TSA wouldn't let me through security without REAL ID or purchasing a $50 wavier, which I couldn't do because I couldn't access an e-mail account from my phone and I didn't have access to my laptop, so I had to rent a car to drive back, forfeiting my return ticket. But renting a car without a REAL ID is almost certainly on someone's list of things to fix.
[1] That's why they wanted it in the first place, to make it easier for them to hunt down terrorists and make it harder for people to slip under the radar of pervasive surveillance.