This is kind of like making sure your backups actually work.
You need to test when servers go down, and people who use them should know and understand what happens when the are off.