Yes, that's precisely the problem, you want continuous learning but you also want continuous pruning.