Distilling Vision-Language Models on Millions of Videos
The research aims to replicate the success of image-text data for video-language models. The researchers fine-tuned a…
ICMC-ASR: The ICASSP 2024 In-Car Multi-Channel Automatic Speech Recognition Challenge
The study presents the ICASSP 2024 In-Car Multi-Channel Automatic Speech Recognition (ICMC-ASR) Challenge. This competition, which follows…
An audio-quality-based multi-strategy approach for target speaker extraction in the MISP 2023 Challenge
The paper discusses a new approach towards audio-visual target speaker extraction (AVTSE) task in the Multi-modal Information…
DJCM: A Deep Joint Cascade Model for Singing Voice Separation and Vocal Pitch Estimation
The paper proposes a DeepJointCascade Model (DJCM) for singing voice separation and vocal pitch estimation tasks in…
Using perceptive subbands analysis to perform audio scenes cartography
This 2005 paper by Laurent Millot, Gerard Pel and Mohammed Elliq presents a method for audio scene…
Efficient Selective Audio Masked Multimodal Bottleneck Transformer for Audio-Video Classification
The article introduces a novel audio-video recognition approach called the Audio-Video Transformer (AVT) that uses effective spatio-temporal…
FunnyNet-W: Multimodal Learning of Funny Moments in Videos in the Wild
The article introduces ‘FunnyNet-W’, a model that relies on cross- and self-attention for visual, audio, and text…
High-precision Voice Search Query Correction via Retrievable Speech-text Embedings
This paper discusses a technique to enhance the accuracy of Automatic Speech Recognition (ASR) systems. The proposed…
FADI-AEC: Fast Score Based Diffusion Model Guided by Far-end Signal for Acoustic Echo Cancellation
The paper proposes two novel models: DI-AEC and FADI-AEC for Acoustic Echo Cancellation (AEC). These models pioneer…
SonicVisionLM: Playing Sound with Vision Language Models
The SonicVisionLM, a novel framework, is designed to generate sound effects for silent videos by leveraging vision…