Compositional Distributional Semantics

This paper discusses the complexity of language model architectures, particularly Transformers, and their use in natural language processing tasks. The author proposes a linguistically motivated strategy for encoding the contextual…