Yes it does, smart switches have buttons that control the relay directly.

Also aside from maintenance there's no reason your WiFi should go down, an inexpensive UPS can keep it up for hours in a power outage. Even if it can't access the outside world, local routing works fine.