That is absolutely a fair critique. In fact, more than fair, I would say.
I'm not even defending it. I'm just describing the mainstream ethical foundation used today.