I have heard this repeated a few times now and it surprises me. Since going deep on Linux I've resented any time I had to use Windows, but folks I really respect often speak highly of the kernel. It'd be cool if they open source it one day and we get a good deep dive into the internals.
Another angle on this: most ATMs were running windows a decade or two ago (I'd assume most still do, but not sure).
You'd see occasional crash screens, but given the sheer number of machines out in the wild, having only a few crash once in a blue moon speaks amply to the reliability of the thing.