krantiparida / awesome-audio-visual
A curated list of different papers and datasets in various areas of audio-visual processing
☆685Updated 11 months ago
Alternatives and similar repositories for awesome-audio-visual:
Users that are interested in awesome-audio-visual are comparing it to the libraries listed below
- A curated list of audio-visual learning methods and datasets.☆242Updated last month
- VGGSound: A Large-scale Audio-Visual Dataset☆301Updated 3 years ago
- Audio-Visual Speech Separation with Cross-Modal Consistency☆225Updated last year
- Pytorch port of Google Research's VGGish model used for extracting audio features.☆379Updated 3 years ago
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆244Updated 9 months ago
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆560Updated 9 months ago
- Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"☆111Updated 4 years ago
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆218Updated 11 months ago
- Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018☆176Updated 3 years ago
- Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and T…☆557Updated 2 months ago
- Deep-Learning-Based Audio-Visual Speech Enhancement and Separation☆205Updated last year
- Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".☆1,199Updated last year
- Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".☆371Updated 2 years ago
- Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)☆128Updated 3 years ago
- The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"☆376Updated 5 months ago
- Efficient Training of Audio Transformers with Patchout☆314Updated last year
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆401Updated last year
- Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)☆786Updated 3 years ago
- Co-Separating Sounds of Visual Objects (ICCV 2019)☆94Updated last year
- ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'☆339Updated last year
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆404Updated 8 months ago
- Learning audio concepts from natural language supervision☆518Updated 4 months ago
- Codebase and Dataset for the paper: Learning to Localize Sound Source in Visual Scenes☆85Updated last month
- soundnet and localize sound source☆11Updated 4 years ago
- Audio Visual Instance Discrimination with Cross-Modal Agreement☆128Updated 3 years ago
- INTERSPEECH 2023-2024 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023-24 conference. …☆651Updated 3 weeks ago
- BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation☆208Updated last year
- Keep track of big models in audio domain, including speech, singing, music etc.☆467Updated 3 months ago
- A curated list of deep learning resources for video-text retrieval.☆602Updated last year
- ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore t…☆427Updated last week