The article introduces ‘Anim-400K’, a large-scale dataset designed to aid in the automated end-to-end dubbing of video content. With 60% of online content published in English and only 18.8% of…
Continue readingThis paper introduces LLM-ST, a model for speech translation developed from a pre-trained large language model (LLM). The model integrates a speech encoder with the LLM and uses multi-task instruction…
Continue readingThe article discusses the application of multi-task learning (MTL) in end-to-end speech translation (ST). It investigates the consistency between different tasks in MTL and their effect on the ST task….
Continue readingThe article presents a novel approach to real-time spoken language transcription and translation using a streaming Transformer-Transducer (T-T) model. The T-T model can jointly produce many-to-one and one-to-many transcription and…
Continue readingThis article deals with Code-switching (CS), the phenomenon of mixing languages in a single sentence, and its challenges in Natural Language Processing (NLP) settings. The study extends existing research on…
Continue readingThe authors introduce a multitask, multilingual, dual-modal Speech and Language Model (SLM). The SLM uses pretrained foundational speech and language models, preserving their capabilities while training a simple adapter with…
Continue readingThe article discusses the development of the Open Whisper-style Speech Model (OWSM), a tool that reproduces the Whisper-style training of speech models using an open-source toolkit and publicly available data….
Continue readingLooks like you're using an ad blocker. Please support us by disabling these ad blocker.
