The cryostat is the most visually impressive part, to be fair.

That's the cool chandelier looking thing, for anyone reading. It's a multi-stage cooler and the actual computer mounts to the bottom. I think the reason it's upside-down is that the liquid phase of the refrigerant medium is the cold part, and gravity holds it where it needs to be. They could probably engineer one that works in any orientation but there's no reason to.