language-specific modular components

This paper discusses the adaptation of multilingual encoders to Swiss German, a language with dialectal variation and limited public training data. The researchers used continued pre-training on Swiss German data,…