The Joint Effect of Task Similarity and Overparameterization on Catastrophic Forgetting — An Analytical Model
The paper presents an in-depth analysis of the joint effect of task similarity and overparameterization on catastrophic forgetting in continual learning. The researchers focus on two-task continual linear regression, where…
Continue reading