Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number
The research investigates how the deep learning model, BERT, conjugates verbs. It shows that BERT’s ability to conjugate verbs is determined by a linear encoding of subject number. This encoding…
Continue reading