GeWu-Lab / awesome-audiovisual-learning
A curated list of audio-visual learning methods and datasets.
☆220Updated last week
Related projects: ⓘ
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆222Updated 6 months ago
- cross modal background suppression for audio-visual event localization☆34Updated 2 years ago
- VGGSound: A Large-scale Audio-Visual Dataset☆285Updated 3 years ago
- av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models☆14Updated 4 months ago
- MUSIC-AVQA, CVPR2022 (ORAL)☆66Updated last year
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆16Updated last month
- Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation" in NeurIPS…☆13Updated 2 years ago
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆82Updated last year
- A curated list of different papers and datasets in various areas of audio-visual processing☆654Updated 7 months ago
- Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'☆41Updated 2 years ago
- download the vggsound dataset☆18Updated 2 years ago
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆77Updated last month
- Research code for NeurIPS 2023 paper "Modality-Independent Teachers Meet Weakly-Supervised Audio-Visual Event Parser"☆15Updated 11 months ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆45Updated 2 years ago
- This package aims at simplifying the download of the AudioCaps dataset.☆29Updated 9 months ago
- [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.☆99Updated 3 months ago
- Multi-Scale Attention for Audio Question Answering☆24Updated last year
- Code for Discriminative Sounding Objects Localization (NeurIPS 2020)☆57Updated 2 years ago
- Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆254Updated 3 months ago
- The repository provides links to collections of influential and interesting research papers from top AI conferences, with open-source cod…☆87Updated 4 months ago
- Localizing Visual Sounds the Hard Way☆76Updated 2 years ago
- Official implementation for AVGN☆32Updated last year
- A dataset for Audio-Visual Sound Event Detection in Movies☆25Updated last year
- ☆57Updated 2 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆50Updated 7 months ago
- Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018☆169Updated 3 years ago
- Scripts for download AudioSet☆65Updated 6 years ago
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆54Updated 7 months ago
- [CVPR 2023] This is the official implementation of "Weakly Supervised Video Emotion Detection and Prediction via Cross-Modal Temporal Era…☆30Updated 2 months ago
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆17Updated last year