YuanGongND / cav-mae
Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
☆238Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for cav-mae
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆547Updated 7 months ago
- The repo host the code and model of MAViL.☆42Updated last year
- VGGSound: A Large-scale Audio-Visual Dataset☆292Updated 3 years ago
- av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models☆14Updated 6 months ago
- A curated list of audio-visual learning methods and datasets.☆233Updated this week
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆205Updated 3 months ago
- Official implementation for AVGN☆34Updated last year
- 🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps☆144Updated 7 months ago
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆89Updated last year
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP☆328Updated 2 years ago
- Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".☆21Updated 3 months ago
- Code for Discriminative Sounding Objects Localization (NeurIPS 2020)☆58Updated 2 years ago
- BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation☆206Updated last year
- Scripts for download AudioSet☆68Updated 7 years ago
- This package aims at simplifying the download of the AudioCaps dataset.☆30Updated 11 months ago
- [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer☆115Updated 7 months ago
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆80Updated 3 months ago
- The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"☆367Updated 3 months ago
- Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".☆365Updated 2 years ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆55Updated 4 months ago
- Source code for models described in the paper "ESResNe(X)t-fbsp: Learning Robust Time-Frequency Transformation of Audio" (https://arxiv.o…☆44Updated 3 years ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆47Updated 2 years ago
- Audio Captioning datasets for PyTorch.☆108Updated 3 weeks ago
- Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)☆30Updated 2 years ago
- cross modal background suppression for audio-visual event localization☆35Updated 2 years ago
- Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'☆43Updated 2 years ago
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆349Updated 4 months ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆51Updated 9 months ago
- Official implement of SpeechFormer written in Python (PyTorch).☆75Updated last year