where you can get a job dictates what city you live near, how much you are paid determines how close you can live to that city, and how much distance you want to keep from your neighbors sets the density you can stand.

Moving to a smaller city changes your job, which changes how much you are paid, which changes how close you can live to the city, and your neighbors may still suck. It's likely that you'll end up in the same soul-sucking commute life that you just left.