I love the approach of this but "It has to not forget. A model that learns continually and overwrites itself is worse than one that does not learn at all."

Is highly misguided.

While the platonic ideal of Lt Commander Data is appealing, The parable of funes the memorious (Jorge Luis Borges) comes to mind.