The creation, transmission, and interpretation of audio signals on computer systems.
The paper proposes HyperGANStrument, a novel neural synthesizer that enhances the generation capability of GANStrument by introducing a pitch-invariant hypernetwork. This hypernetwork modulates the weights of a pre-trained GANStrument generator,…
Continue readingThe paper introduces MAGNET, a masked generative sequence modeling method that operates directly over several streams of audio tokens. Unlike previous works, MAGNET is a single-stage, non-autoregressive transformer. During training,…
Continue readingThis article introduces a system for real-time and continuous turn-taking prediction in spoken dialogue systems (SDSs). The system is based on a model called voice activity projection (VAP), which maps…
Continue readingThe article discusses the limitations of conventional audio classification methods and introduces a novel method that incorporates counterfactual analysis. The proposed model considers acoustic characteristics and sound source information from…
Continue readingThe research focuses on the match-mismatch classification with EEG recording using self-supervised speech representation and contextual text embedding. The researchers employed a deep convolutional network to extract spatiotemporal features from…
Continue readingThe article discusses the development of a full-frequency dynamic convolution (FFDConv) for sound event detection. Traditional 2D convolution was found to be ineffective for this task, as it enforces translation…
Continue readingThe article introduces ‘Anim-400K’, a large-scale dataset designed to aid in the automated end-to-end dubbing of video content. With 60% of online content published in English and only 18.8% of…
Continue readingThis article discusses a comparative study investigating the performances of three models: a proposed convolutional neural network (CNN), the VGG16 with fully connected layers (FC), and an eXtreme Gradient Boosting…
Continue readingDiffSHEG offers a solution for speech-driven holistic 3D expression and gesture generation. Unlike previous research that focused on individual generation of expression or gesture, DiffSHEG facilitates a joint generation, improving…
Continue readingThe article introduces MuTox, a multilingual audio-based toxicity detection system. It’s the first of its kind, with a dataset that includes 20,000 audio utterances for English and Spanish, and 4,000…
Continue readingLooks like you're using an ad blocker. Please support us by disabling these ad blocker.
