Alternatives and similar repositories for awesome-audio-visual:

Users that are interested in awesome-audio-visual are comparing it to the libraries listed below

• GeWu-Lab / awesome-audiovisual-learning
  A curated list of audio-visual learning methods and datasets.
  ☆244Updated 2 months ago
• hche11 / VGGSound
  VGGSound: A Large-scale Audio-Visual Dataset
  ☆303Updated 3 years ago
• facebookresearch / VisualVoice
  Audio-Visual Speech Separation with Cross-Modal Consistency
  ☆227Updated last year
• YuanGongND / cav-mae
  Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
  ☆246Updated 11 months ago
• afourast / avobjects
  Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"
  ☆111Updated 4 years ago
• YapengTian / AVE-ECCV18
  Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018
  ☆178Updated 3 years ago
• harritaylor / torchvggish
  Pytorch port of Google Research's VGGish model used for extracting audio features.
  ☆380Updated 3 years ago
• facebookresearch / AudioMAE
  This repo hosts the code and models of "Masked Autoencoders that Listen".
  ☆568Updated 10 months ago
• smeetrs / deep_avsr
  A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.
  ☆219Updated last year
• YuanGongND / ssast
  Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".
  ☆374Updated 2 years ago
• YuanGongND / ast
  Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".
  ☆1,219Updated last year
• facebookresearch / Listen-to-Look
  Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)
  ☆128Updated 3 years ago
• RetroCirce / HTS-Audio-Transformer
  The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"
  ☆386Updated 6 months ago
• danmic / av-se
  Deep-Learning-Based Audio-Visual Speech Enhancement and Separation
  ☆205Updated last year
• danieljf24 / awesome-video-text-retrieval
  A curated list of deep learning resources for video-text retrieval.
  ☆605Updated last year
• rhgao / co-separation
  Co-Separating Sounds of Visual Objects (ICCV 2019)
  ☆94Updated last year
• kkoutini / PaSST
  Efficient Training of Audio Transformers with Patchout
  ☆318Updated last year
• asteroid-team / torch-audiomentations
  Fast audio data augmentation in PyTorch. Inspired by audiomentations. Useful for deep learning.
  ☆1,001Updated last month
• DmitryRyumin / INTERSPEECH-2023-24-Papers
  INTERSPEECH 2023-2024 Papers: A complete collection of influential and exciting research papers from the INTERSPEECH 2023-24 conference. …
  ☆656Updated last month
• EmulationAI / awesome-large-audio-models
  Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.
  ☆654Updated 6 months ago
• TaoRuijie / TalkNet-ASD
  ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'
  ☆346Updated last year
• YuanGongND / ltu
  Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".
  ☆413Updated 9 months ago
• hangzhaomit / Sound-of-Pixels
  Codebase for ECCV18 "The Sound of Pixels"
  ☆374Updated 2 years ago
• tcvrick / audioset-vggish-tensorflow-to-pytorch
  Script for converting the pretrained VGGish model provided with AudioSet from TensorFlow to PyTorch, along with a basic smoke test.
  ☆85Updated 5 years ago
• AndreyGuzhov / AudioCLIP
  Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)
  ☆794Updated 3 years ago
• nttcslab / byol-a
  BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation
  ☆209Updated last year
• facebookresearch / sound-spaces
  A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple task…
  ☆373Updated last year
• ardasnck / learning_to_localize_sound_source
  Codebase and Dataset for the paper: Learning to Localize Sound Source in Visual Scenes
  ☆86Updated 2 months ago
• microsoft / CLAP
  Learning audio concepts from natural language supervision
  ☆525Updated 5 months ago
• v-iashin / video_features
  Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and T…
  ☆567Updated 3 weeks ago