[ACMMM 2025] CCStereo: Audio-Visual Contextual and Contrastive Learning for Binaural Audio Generation
☆11Nov 4, 2025Updated last year
Alternatives and similar repositories for CCStereo
Users that are interested in CCStereo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of "ViSAGe: Video-to-Spatial AUdio Generation" (ICLR 2025)☆49Sep 10, 2025Updated last year
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆29Jun 6, 2022Updated 4 years ago
- VGGSounder, a multi-label audio-visual classification dataset with modality annotations.☆19Jun 30, 2026Updated 4 months ago
- One embedding space for text, image, video, audio, thermal, motion, and touch. Open weights, self-hostable.☆17Aug 5, 2026Updated 3 months ago
- Siamese Vision Transformers are Scalable Audio-visual Learners☆14Apr 1, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACM MM 2025] AlignDiT: Multimodal Aligned Diffusion Transformer for Synchronized Speech Generation☆24Sep 17, 2026Updated last month
- Source code of our ACM MM'25 accepted paper "Audio Does Matter: Importance-Aware Multi-Granularity Fusion for Video Moment Retrieval".☆14Feb 9, 2026Updated 8 months ago
- [ICASSP 2025] V2SFlow: Video-to-Speech Generation with Speech Decomposition and Rectified Flow☆21Jun 3, 2025Updated last year
- [ICLR 2026] An official implementation of "STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence"☆48Apr 19, 2026Updated 6 months ago
- [ICCV'25] Official PyTorch Implementation of "VoiceCraft-Dub: Automated Video Dubbing with Neural Codec Language Models"☆18Dec 8, 2025Updated 11 months ago
- ☆17Apr 30, 2026Updated 6 months ago
- FourierFlow: Frequency-aware Flow Matching for Generative Turbulence Modeling☆17Jun 1, 2025Updated last year
- Official implementation of Contextual Speech Extraction (ICASSP 2025)☆11Mar 17, 2025Updated last year
- The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…☆10Oct 12, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICLR'25] Official repository for "AVHBench: A Cross-Modal Hallucination Evaluation for Audio-Visual Large Language Models"☆27Mar 8, 2026Updated 8 months ago
- ☆12Sep 2, 2024Updated 2 years ago
- Official Pytorch implementation of "Omni-AVSR: Towards Unified Multimodal Speech Recognition with Large Language Models" [IEEE ICASSP 202…☆38Aug 20, 2026Updated 2 months ago
- "Causality: Models, Reasoning, and Inference-Judea Pearl(2009)"中文翻译及学习笔记☆20Feb 18, 2022Updated 4 years ago
- Codebase for the paper "Visually Informed Binaural Audio Generation without Binaural Audios" (CVPR 2021)☆72Jul 8, 2021Updated 5 years ago
- [CVPR 2025] Crab: A Unified Audio-Visual Scene Understanding Model with Explicit Cooperation☆85Dec 24, 2025Updated 10 months ago
- Official Implementation of Video-MA2MBA☆12Dec 3, 2024Updated last year
- ☆12Jun 24, 2026Updated 4 months ago
- SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial Sound☆142Mar 28, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official source code for the paper "Tailored Design of Audio-Visual Speech Recognition Models using Branchformers"☆15Feb 24, 2025Updated last year
- Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge (ICCV 2023)☆11Sep 3, 2024Updated 2 years ago
- ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation☆41Nov 20, 2024Updated last year
- Official Code implementation for the ICLR paper "LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading"☆90Sep 19, 2024Updated 2 years ago
- ☆64Oct 19, 2025Updated last year
- An objective reconstruction evaluation toolkit for audio tokenizers, neural codecs, audio VAEs, and vocoders☆15Jun 16, 2026Updated 4 months ago
- Pytorch implementation of "Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-training and Multi-modal T…☆12Apr 29, 2026Updated 6 months ago
- ☆10Apr 25, 2025Updated last year
- [CVPR 2024] "Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition"☆11Feb 27, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [ICML 2025] PyTorch Implementation of "OmniAudio: Generating Spatial Audio from 360-Degree Video"☆377Jun 27, 2025Updated last year
- ☆12Aug 2, 2025Updated last year
- Connected Papers knockoff, managing academic papers and citations with graph database.☆12Dec 26, 2023Updated 2 years ago
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆47Oct 26, 2024Updated 2 years ago
- Code for "Weakly-supervised Fingerspelling Recognition in British Sign Language Videos", BMVC 2022.☆12Jun 22, 2023Updated 3 years ago
- ViSAudio: End-to-End Video-Driven Binaural Spatial Audio Generation☆118Oct 13, 2026Updated 3 weeks ago
- This repository contains the speaker labeled information of VoxCeleb2 and LRS3 audio-visual datasets. (AAAI 2025)☆13Sep 6, 2024Updated 2 years ago