krantiparida / awesome-audio-visualLinks
A curated list of different papers and datasets in various areas of audio-visual processing
☆745Updated last year
Alternatives and similar repositories for awesome-audio-visual
Users that are interested in awesome-audio-visual are comparing it to the libraries listed below
Sorting:
- VGGSound: A Large-scale Audio-Visual Dataset☆334Updated 4 years ago
- A curated list of audio-visual learning methods and datasets.☆270Updated 10 months ago
- Pytorch port of Google Research's VGGish model used for extracting audio features.☆399Updated 3 years ago
- Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018☆192Updated 4 years ago
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆270Updated last year
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆616Updated last year
- Audio-Visual Speech Separation with Cross-Modal Consistency☆235Updated 2 years ago
- Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)☆845Updated 4 years ago
- Codebase and Dataset for the paper: Learning to Localize Sound Source in Visual Scenes☆93Updated 10 months ago
- Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"☆113Updated 4 years ago
- Co-Separating Sounds of Visual Objects (ICCV 2019)☆97Updated 2 years ago
- Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".☆1,347Updated 2 years ago
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆237Updated last year
- Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)☆129Updated 4 years ago
- Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".☆399Updated 3 years ago
- Efficient Training of Audio Transformers with Patchout☆351Updated last year
- A self-supervised learning framework for audio-visual speech☆939Updated last year
- The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"☆434Updated 2 weeks ago
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆89Updated last year
- Codebase for ECCV18 "The Sound of Pixels"☆386Updated 3 years ago
- Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP☆355Updated 3 years ago
- download the vggsound dataset☆22Updated 3 years ago
- Deep-Learning-Based Audio-Visual Speech Enhancement and Separation☆214Updated 2 years ago
- [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer☆317Updated 3 months ago
- Code for Discriminative Sounding Objects Localization (NeurIPS 2020)☆59Updated 3 years ago
- Localizing Visual Sounds the Hard Way☆82Updated 3 years ago
- Learning audio concepts from natural language supervision☆599Updated last year
- Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation" in NeurIPS…☆14Updated 3 years ago
- soundnet and localize sound source☆11Updated 4 years ago
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆420Updated 2 years ago