krantiparida / awesome-audio-visual
A curated list of different papers and datasets in various areas of audio-visual processing
☆722Updated last year
Alternatives and similar repositories for awesome-audio-visual
Users that are interested in awesome-audio-visual are comparing it to the libraries listed below
Sorting:
- A curated list of audio-visual learning methods and datasets.☆258Updated 5 months ago
- VGGSound: A Large-scale Audio-Visual Dataset☆318Updated 3 years ago
- Audio-Visual Speech Separation with Cross-Modal Consistency☆230Updated last year
- Pytorch port of Google Research's VGGish model used for extracting audio features.☆388Updated 3 years ago
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆256Updated last year
- Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018☆184Updated 4 years ago
- Deep-Learning-Based Audio-Visual Speech Enhancement and Separation☆208Updated 2 years ago
- Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"☆113Updated 4 years ago
- ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'☆377Updated last year
- INTERSPEECH 2023-2024 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023-24 conference. …☆668Updated 4 months ago
- The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"☆407Updated 9 months ago
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆227Updated last year
- ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore t…☆460Updated last week
- Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".☆381Updated 2 years ago
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆585Updated last year
- Codebase and Dataset for the paper: Learning to Localize Sound Source in Visual Scenes☆90Updated 5 months ago
- Script for converting the pretrained VGGish model provided with AudioSet from TensorFlow to PyTorch, along with a basic smoke test.☆87Updated 6 years ago
- Co-Separating Sounds of Visual Objects (ICCV 2019)☆95Updated last year
- Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)☆129Updated 3 years ago
- Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)☆815Updated 3 years ago
- soundnet and localize sound source☆11Updated 4 years ago
- Efficient Training of Audio Transformers with Patchout☆334Updated last year
- Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".☆1,282Updated last year
- A tutorial for Speech Enhancement researchers and practitioners. The purpose of this repo is to organize the world’s resources for speech…☆763Updated 4 years ago
- Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.☆673Updated 9 months ago
- Pytorch code for End-to-End Audiovisual Speech Recognition☆177Updated 2 years ago
- Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)☆86Updated 9 months ago
- A self-supervised learning framework for audio-visual speech☆902Updated last year
- A must-read paper for speech separation based on neural networks☆779Updated 3 years ago
- Learning audio concepts from natural language supervision☆554Updated 7 months ago