As I understand, the problem of continual learning is that if you continue training, it will "overwrite" previous knowledge and this CPU will be lost
There is nothing in theory preventing you from training while keeping a subset of weights locked.
[flagged]
There is nothing in theory preventing you from training while keeping a subset of weights locked.