How many of those people had 400 million dollars to their name?

You're discounting the risk of inheriting a large sum of money while surrounded by criminals. Getting sudden access to that sort of money is dangerous at the best of times. I'd be scared enough outside of prison, let alone in the presence of organized crime.

Why are you so sure you'd be left alone?