sangho-vision / acav100m
ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.
☆54Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for acav100m
- This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …☆34Updated last year
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- ☆21Updated 11 months ago
- Evaluation script for VoxMovies dataset in PyTorch☆22Updated 10 months ago
- Official implementation for MGN☆20Updated last year
- [ACCV 2024] Official Implementation of "AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description". Junyu Xie, Tengda Han, M…☆17Updated last month
- ☆31Updated 3 years ago
- [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …☆70Updated 9 months ago
- [CVPR'23 Highlight] AutoAD: Movie Description in Context.☆88Updated 2 weeks ago
- This repository contains the code for our ECCV 2022 paper "Temporal and cross-modal attention for audio-visual zero-shot learning"☆24Updated last year
- ☆74Updated 2 years ago
- ☆52Updated 2 years ago
- PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)☆120Updated last year
- ☆102Updated last year
- Official implementation for AVGN☆34Updated last year
- multimodal video-audio-text generation and retrieval between every pair of modalities on the MUGEN dataset. The repo. contains the traini…☆39Updated last year
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆49Updated 2 years ago
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆80Updated 3 months ago
- VideoCC is a dataset containing (video-URL, caption) pairs for training video-text machine learning models. It is created using an automa…☆76Updated last year
- Multi-Scale Attention for Audio Question Answering☆27Updated last year
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆47Updated 2 years ago
- Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"☆137Updated 2 years ago
- PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)☆32Updated last year
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆37Updated 3 months ago
- ☆50Updated 2 years ago
- ☆31Updated last year
- MUSIC-AVQA, CVPR2022 (ORAL)☆67Updated last year
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆89Updated last year
- ☆14Updated 3 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆51Updated 9 months ago