Exponential decay isn't impossible to manage if the exponent is reasonable (i.e. closer to 1, i.e. if the average number of children per woman was closer to 2.1). It's just going down too fast.