CREMA: Multimodal Compositional Video Reasoning via Efficient Modular Adaptation and Fusion
This paper introduces CREMA, a new and efficient modality-fusion framework designed to improve video reasoning. By leveraging…
ClickSAM: Fine-tuning Segment Anything Model using click prompts for ultrasound image segmentation
The Segment Anything Model (SAM) is a widely used tool for image processing, but its application in…
SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models
The article introduces SPHINX-X, a series of Multi-modality Large Language Models (MLLMs) developed based on SPHINX. This…
Scalable Diffusion Models with State Space Backbone
The paper introduces a new category of diffusion models built on state space architecture for image data….
Extending 6D Object Pose Estimators for Stereo Vision
The article discusses the challenge of 6D object pose estimation and the improved accuracy achieved by incorporating…
DAPlankton: Benchmark Dataset for Multi-instrument Plankton Recognition via Fine-grained Domain Adaptation
The paper presents a new dataset called DAPlankton for developing and benchmarking domain adaptation methods for image…
Learning pseudo-contractive denoisers for inverse problems
The article presents a novel training strategy for deep denoisers in signal and image processing. The strategy…
Real-time Holistic Robot Pose Estimation with Unknown States
The article presents a new method for estimating robot pose from RGB images, even when robot internal…
An Ordinal Regression Framework for a Deep Learning Based Severity Assessment for Chest Radiographs
This research presents an ordinal regression framework for assessing disease severity in chest radiographs using deep learning….
DiffSpeaker: Speech-Driven 3D Facial Animation with Diffusion Transformer
This article introduces DiffSpeaker, a new model for speech-driven 3D facial animation. Traditional models use either Diffusion…