Decoupled Knowledge with Ensemble Learning for Online Distillation
The article presents a study on the issue of model collapse in peer collaborative learning (PCL). The authors analyze the high homogenization between the student and teacher as the cause…
Continue reading