facebookresearch / MAViL
The repo host the code and model of MAViL.
☆42Updated last year
Related projects ⓘ
Alternatives and complementary repositories for MAViL
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆238Updated 8 months ago
- Official Implementation of the work "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning"☆101Updated 2 weeks ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆110Updated last year
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆47Updated 2 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆51Updated 9 months ago
- Source code for the paper 'Audio Captioning Transformer'☆50Updated 2 years ago
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆205Updated 3 months ago
- Python code for handling the Clotho dataset.☆77Updated 4 years ago
- This package aims at simplifying the download of the AudioCaps dataset.☆30Updated 11 months ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆77Updated 5 months ago
- ☆59Updated 2 years ago
- Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'☆43Updated 2 years ago
- Audio Captioning datasets for PyTorch.☆108Updated 2 weeks ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆55Updated 4 months ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆49Updated 7 months ago
- ☆16Updated last year
- Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"☆14Updated 7 months ago
- Scripts for download AudioSet☆68Updated 7 years ago
- A dataset for Audio-Visual Sound Event Detection in Movies☆26Updated last year
- Pytorch implementation for “V2C: Visual Voice Cloning”☆30Updated last year
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆36Updated 3 months ago
- ☆45Updated 2 years ago
- 🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps☆144Updated 7 months ago
- Official implementation for AVGN☆34Updated last year
- Unofficial PyTorch implementation of Masked Autoencoders that Listen☆64Updated 2 years ago
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆81Updated this week
- Repo for Visual Acoustic Matching, CVPR 2022☆65Updated last year
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression☆13Updated last month
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆33Updated last month