What would it mean for them to not exist?

The issue, as I see it, is that elite credentials are overvalued, and that we live in a society which is becoming more and more unequal, and where housing prices in particular are skyrocketing.

Without solving that, the alternatives to the Ivy League (e.g. undisguised nepotism) seem to be even worse.