bilingual language model

This article introduces CroissantLLM, a 1.3 billion language model trained on 3 trillion English and French tokens. It is a high-performance, fully open-source bilingual model that operates on consumer-grade local…