LumiNet: The Bright Side of Perceptual Knowledge Distillation
The research introduces LumiNet, a new knowledge-transfer algorithm designed to improve logit-based knowledge distillation. It aims to boost the student model’s learning depth by recalibrating logits based on the model’s…
Continue reading