> you lose all the users who don't want to leave the walled garden, even though they can.

I think it's moreso you lose all the users who don't realize anything outside the walled garden even exists.