sangho-vision / acav100m
ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.
☆56Updated 3 years ago
Alternatives and similar repositories for acav100m:
Users that are interested in acav100m are comparing it to the libraries listed below
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- ☆22Updated last year
- [CVPR'23 Highlight] AutoAD: Movie Description in Context.☆94Updated 4 months ago
- multimodal video-audio-text generation and retrieval between every pair of modalities on the MUGEN dataset. The repo. contains the traini…☆39Updated last year
- Official implementation for MGN☆20Updated 2 years ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆51Updated 2 years ago
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆50Updated 2 years ago
- EgoCom: A Multi-person Multi-modal Egocentric Communications Dataset☆56Updated 4 years ago
- Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"☆139Updated 2 years ago
- Official implementation for AVGN☆34Updated last year
- ☆63Updated 2 years ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆80Updated 8 months ago
- MUSIC-AVQA, CVPR2022 (ORAL)☆77Updated 2 years ago
- ☆108Updated 2 years ago
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆84Updated 7 months ago
- Official repository of PanoAVQA: Grounded Audio-Visual Question Answering in 360° Videos (ICCV 2021)☆14Updated 3 years ago
- ☆31Updated 3 years ago
- This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …☆36Updated 2 years ago
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆99Updated last year
- [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …☆73Updated last year
- [CVPR 2023] Egocentric Audio-Visual Object Localization☆24Updated last year
- Sapsucker Woods 60 Audiovisual Dataset☆15Updated 2 years ago
- ☆31Updated 2 years ago
- VideoCC is a dataset containing (video-URL, caption) pairs for training video-text machine learning models. It is created using an automa…☆77Updated 2 years ago
- ☆72Updated 10 months ago
- MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptions☆159Updated last year
- Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)☆50Updated last month
- [ACCV 2024] Official Implementation of "AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description". Junyu Xie, Tengda Han, M…☆23Updated last month
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆112Updated 2 years ago
- PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)☆123Updated 2 years ago