information bottleneck principle

The article discusses the challenges of high computational cost and high-dimensional representation in pre-trained language models (PLMs) for text representation. To overcome these issues, the authors propose a novel Knowledge…