Nonsense, people aren't "sent" they leave because the rural areas are fundamentally obsolete, they offer very limited lives, and produce very little.
They offer no reason to stay.
Their government takes money from a productive area to subsidize a rural one, in a feelgood program to purchase the votes of the non productive at the cost of a higher tax burden elsewhere.
From the city's perspective the countryside is an incredibly expensive way to provide some quantity of raw material, not some wellspring of labour since the 19th century.
"Justice" is a wrong word to use here, I think, as its both vague and subjective. But your position is unsustainable. For starters you simply don't want your country to be a few 1st world cities within a 3rd world hinterland, cause it's sure way to cultural disintegration, political polarization, increased crime, and poor defensibility in military sense. You really want to maintain your country as a whole.