Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model
The study investigates the potential of transferring ‘complementary’ knowledge from one pretrained model to another without performance degradation. This task is complex as additional knowledge can be contained in stronger,…
Continue reading