A good reason you have to use these sticks is stand-alone devices.

For example, you need to print something; take some data from an oscilloscope or other instrument.

Your alternatives are to connect those devices to your network or some devices run Windows you can alt-tab out of and install your own software. Given risks and complexity of those, a hardware encrypted USB stick is the least bad.