There are certainly edge cases where you want native USB and display, but after initial bring up, the device is on the network, and can be managed over the network.

So, sure, nerd out and add more hardware to your rack, but I need a physical keyboard and mouse attached to a machine in my rack like once per year.