Press ESC to close

knowledge transfer

Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model

root 0

The study investigates the potential of transferring ‘complementary’ knowledge from one pretrained model to another without performance degradation. This task is complex as additional knowledge can be contained in stronger,…

Continue reading

Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model

root 0

The research paper investigates the possibility of transferring ‘complementary’ knowledge between any arbitrary pairing of pretrained models, without any performance degradation. The authors found that each model learns unique feature…

Continue reading