The twin peaks of learning neural networks
The article studies the impact of overparameterization on the complexity and sensitivity of the function represented by neural networks. It discusses the ‘double-descent’ phenomenon, where highly overparameterized models escape overfitting…
Continue reading