Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
☆57Jan 29, 2024Updated 2 years ago
Alternatives and similar repositories for SparseSync
Users that are interested in SparseSync are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆25Feb 20, 2024Updated 2 years ago
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".☆94Dec 8, 2023Updated 2 years ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)☆37Feb 11, 2026Updated 8 months ago
- Official PyTorch implementation of the TIP paper "Generating Visually Aligned Sound from Videos" and the corresponding Visually Aligned S…☆53Dec 15, 2020Updated 5 years ago
- Localizing Visual Sounds the Hard Way☆84Jul 6, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices☆73Apr 7, 2024Updated 2 years ago
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)☆138Sep 15, 2025Updated last year
- Research code for NeurIPS 2023 paper "Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser"☆17Jul 13, 2025Updated last year
- Python implementation of the paper " Dynamic Temporal Alignment of Speech to Lips"☆33May 16, 2019Updated 7 years ago
- ☆23Mar 31, 2022Updated 4 years ago
- A dataset for Audio-Visual Sound Event Detection in Movies☆26Jan 23, 2023Updated 3 years ago
- A curated list of audio-visual learning methods and datasets.☆296Dec 3, 2024Updated last year
- ☆11Feb 7, 2024Updated 2 years ago
- Audio-visual sound localization☆11Mar 8, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆44Jul 16, 2026Updated 3 months ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆58Apr 17, 2024Updated 2 years ago
- ☆61Oct 4, 2026Updated 3 weeks ago
- Splits for epic-sounds dataset☆87Aug 2, 2025Updated last year
- SyncFusion: Multimodal Onset-synchronized Video-to-Audio Foley Synthesis☆19Jul 22, 2024Updated 2 years ago
- Visual Speech Recognition For Low-Resource Languages with Automatic Labels (ICASSP 2024)☆18Mar 17, 2025Updated last year
- Transformer-based visually grounded speech models☆19Sep 22, 2022Updated 4 years ago
- We present Hear-Your-Click, an interactive framework enabling targeted object audio generation via clicks.☆13Jul 20, 2025Updated last year
- Research code for "Towards multi-task learning of speech and speaker recognition" at https://arxiv.org/pdf/2302.12773.pdf☆12Dec 2, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆21Feb 15, 2022Updated 4 years ago
- Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"☆114Nov 16, 2020Updated 5 years ago
- Official repo for DisCodec presented at Audio Imagination Workshop @NeurIPS 2024☆14Dec 18, 2024Updated last year
- [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners☆155Jul 6, 2024Updated 2 years ago
- ☆22Mar 18, 2023Updated 3 years ago
- [🏆 IJCV 2025 & ACCV 2024 Best Paper Honorable Mention] Official pytorch implementation of the paper "High-Quality Visually-Guided Sound …☆36Mar 30, 2026Updated 7 months ago
- ☆19Jan 30, 2023Updated 3 years ago
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆292Mar 20, 2024Updated 2 years ago
- Sapsucker Woods 60 Audiovisual Dataset☆19Oct 7, 2022Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ACM MM 2022 paper_AVQA: A Dataset for Audio-Visual Question Answering on Videos☆15Aug 17, 2023Updated 3 years ago
- A Python port of the MATLAB reference implementation☆67Jul 18, 2023Updated 3 years ago
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆20Aug 20, 2026Updated 2 months ago
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆207May 29, 2024Updated 2 years ago
- Code for the paper: Audio-Visual Scene Analysis with Self-Supervised Multisensory Features☆225Jul 17, 2019Updated 7 years ago
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆51Dec 17, 2024Updated last year
- AlignNet: A Unifying Approach to Audio-Visual Alignment (WACV 2020)☆34Jan 10, 2021Updated 5 years ago