There is nothing in theory preventing you from training while keeping a subset of weights locked.
How do you ensure that subset of the weights will continue to be accessible through the others?
alt Hacker News
How do you ensure that subset of the weights will continue to be accessible through the others?