Contextualized word senses: from attention to compositionality
This paper discusses the complexity of language model architectures, particularly Transformers, and their use in natural language processing tasks. The author proposes a linguistically motivated strategy for encoding the contextual…
Continue reading