Alternatives and similar repositories for awesome-audio-visual

Users that are interested in awesome-audio-visual are comparing it to the libraries listed below

• hche11 / VGGSound
  VGGSound: A Large-scale Audio-Visual Dataset
  ☆327Updated 3 years ago
• GeWu-Lab / awesome-audiovisual-learning
  A curated list of audio-visual learning methods and datasets.
  ☆263Updated 9 months ago
• YapengTian / AVE-ECCV18
  Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018
  ☆190Updated 4 years ago
• YuanGongND / cav-mae
  Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
  ☆269Updated last year
• harritaylor / torchvggish
  Pytorch port of Google Research's VGGish model used for extracting audio features.
  ☆397Updated 3 years ago
• facebookresearch / VisualVoice
  Audio-Visual Speech Separation with Cross-Modal Consistency
  ☆234Updated 2 years ago
• facebookresearch / AudioMAE
  This repo hosts the code and models of "Masked Autoencoders that Listen".
  ☆610Updated last year
• AndreyGuzhov / AudioCLIP
  Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)
  ☆842Updated 3 years ago
• afourast / avobjects
  Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"
  ☆113Updated 4 years ago
• ardasnck / learning_to_localize_sound_source
  Codebase and Dataset for the paper: Learning to Localize Sound Source in Visual Scenes
  ☆92Updated 9 months ago
• v-iashin / video_features
  Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and T…
  ☆611Updated 7 months ago
• facebookresearch / Listen-to-Look
  Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)
  ☆129Updated 4 years ago
• rhgao / co-separation
  Co-Separating Sounds of Visual Objects (ICCV 2019)
  ☆96Updated 2 years ago
• hche11 / Localizing-Visual-Sounds-the-Hard-Way
  Localizing Visual Sounds the Hard Way
  ☆81Updated 3 years ago
• smeetrs / deep_avsr
  A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.
  ☆234Updated last year
• descriptinc / lyrebird-wav2clip
  Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP
  ☆355Updated 3 years ago
• hangzhaomit / Sound-of-Pixels
  Codebase for ECCV18 "The Sound of Pixels"
  ☆385Updated 3 years ago
• YapengTian / AVVP-ECCV20
  Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)
  ☆89Updated last year
• hhc1997 / vggsound_download
  download the vggsound dataset
  ☆22Updated 3 years ago
• TaoRuijie / TalkNet-ASD
  ACM MM 2021: 'Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection'
  ☆417Updated last year
• Yu-Wu / Modaily-Aware-Audio-Visual-Video-Parsing
  Code for CVPR 2021 paper Exploring Heterogeneous Clues for Weakly-Supervised Audio-Visual Video Parsing
  ☆24Updated 3 years ago
• CheyneyComputerScience / CREMA-D
  Crowd Sourced Emotional Multimodal Actors Dataset (CREMA-D)
  ☆460Updated 5 months ago
• danmic / av-se
  Deep-Learning-Based Audio-Visual Speech Enhancement and Separation
  ☆211Updated 2 years ago
• wzk1015 / video-bgm-generation
  [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer
  ☆319Updated 2 months ago
• microsoft / CLAP
  Learning audio concepts from natural language supervision
  ☆586Updated 11 months ago
• RetroCirce / HTS-Audio-Transformer
  The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"
  ☆429Updated last year
• DTaoo / Discriminative-Sounding-Objects-Localization
  Code for Discriminative Sounding Objects Localization (NeurIPS 2020)
  ☆59Updated 3 years ago
• jasongief / PSP_CVPR_2021
  [2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line
  ☆43Updated 3 years ago
• FloretCat / CMRAN
  Cross-Modal Relation-Aware Networks for Audio-Visual Event Localization， ACM MM 2020
  ☆33Updated 4 years ago
• YuanGongND / ssast
  Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".
  ☆395Updated 3 years ago