Text Representation Distillation via Information Bottleneck Principle
The article discusses the challenges of high computational cost and high-dimensional representation in pre-trained language models (PLMs) for text representation. To overcome these issues, the authors propose a novel Knowledge…
Continue reading