If you use something you can control, like a Linux box, this isn't an issue. Even if the device did get added, and then udev or network manager auto configured, a firewall script should protect you.