Alternatives and similar repositories for multisensory

Users that are interested in multisensory are comparing it to the libraries listed below

• rohitrango / objects-that-sound

  View on GitHub
  Unofficial Implementation of Google Deepmind's paper `Objects that Sound`
  ☆83May 7, 2018Updated 7 years ago
• hangzhaomit / Sound-of-Pixels

  View on GitHub
  Codebase for ECCV18 "The Sound of Pixels"
  ☆390Apr 25, 2022Updated 3 years ago
• rhgao / Deep-MIML-Network

  View on GitHub
  Learning to Separate Object Sounds by Watching Unlabeled Video (ECCV 2018)
  ☆50Sep 24, 2019Updated 6 years ago
• crystal-method / Looking-to-Listen

  View on GitHub
  ☆40Jul 19, 2018Updated 7 years ago
• bill9800 / speech_separation

  View on GitHub
  Include some core functions and model to handle speech separation
  ☆156Jun 24, 2021Updated 4 years ago
• mayurnewase / looking-to-listen-at-cocktail-party

  View on GitHub
  Looking to listen at cocktail party
  ☆36Mar 24, 2023Updated 2 years ago
• ajinkyaT / Lip_Reading_in_the_Wild_AVSR

  View on GitHub
  Audio-Visual Speech Recognition using Deep Learning
  ☆61Nov 14, 2018Updated 7 years ago
• v-iashin / SparseSync

  View on GitHub
  Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)
  ☆54Jan 29, 2024Updated 2 years ago
• ardasnck / learning_to_localize_sound_source

  View on GitHub
  Codebase and Dataset for the paper: Learning to Localize Sound Source in Visual Scenes
  ☆97Dec 4, 2024Updated last year
• ubc-vision / TriBERT

  View on GitHub
  Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation" in NeurIPS…
  ☆14Dec 9, 2021Updated 4 years ago
• roudimit / MUSIC_dataset

  View on GitHub
  MUSIC Dataset from The Sound of Pixels (ECCV '18)
  ☆135Aug 12, 2022Updated 3 years ago
• hche11 / Localizing-Visual-Sounds-the-Hard-Way

  View on GitHub
  Localizing Visual Sounds the Hard Way
  ☆82Jul 6, 2022Updated 3 years ago
• rhgao / co-separation

  View on GitHub
  Co-Separating Sounds of Visual Objects (ICCV 2019)
  ☆99Jul 25, 2023Updated 2 years ago
• hrtavakoli / DAVE

  View on GitHub
  ☆26Nov 30, 2019Updated 6 years ago
• SheldonTsui / SepStereo_ECCV2020

  View on GitHub
  Codebase for the paper "Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation" (ECCV2020)
  ☆72Oct 20, 2020Updated 5 years ago
• tstafylakis / Lipreading-ResNet

  View on GitHub
  Torch code for using Residual Networks with LSTMs for Lipreading
  ☆99Oct 8, 2018Updated 7 years ago
• krantiparida / awesome-audio-visual

  View on GitHub
  A curated list of different papers and datasets in various areas of audio-visual processing
  ☆765Jan 30, 2024Updated 2 years ago
• YapengTian / AVVP-ECCV20

  View on GitHub
  Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing, ECCV, 2020. (Spotlight)
  ☆89Jul 25, 2024Updated last year
• Gasoonjia / tvnet_pytorch

  View on GitHub
  Tvnet implemented in pytorch
  ☆45Apr 9, 2019Updated 6 years ago
• NervanaSystems / neon_segnet

  View on GitHub
  neon implementation of SegNet
  ☆13Jan 3, 2023Updated 3 years ago
• V-Sense / 360AudioVisual

  View on GitHub
  This repository contains materials for the paper: Towards generating ambisonics using audio-visual cue for virtual reality
  ☆13Jul 2, 2019Updated 6 years ago
• ycemsubakan / sourceseparation_misc

  View on GitHub
  ☆47Jul 30, 2018Updated 7 years ago
• cvondrick / soundnet

  View on GitHub
  SoundNet: Learning Sound Representations from Unlabeled Video. NIPS 2016
  ☆464Oct 7, 2017Updated 8 years ago
• dr-pato / audio_visual_speech_enhancement

  View on GitHub
  Face Landmark-based Speaker-Independent Audio-Visual Speech Enhancement in Multi-Talker Environments
  ☆111Mar 19, 2024Updated last year
• changil / avspeech-downloader

  View on GitHub
  AVSpeech downloader
  ☆68Jan 30, 2019Updated 7 years ago
• turpaultn / DCASE2019_task4

  View on GitHub
  Baseline of dcase 2019 task 4
  ☆62Sep 2, 2022Updated 3 years ago
• awentzonline / pytorch-cns

  View on GitHub
  Generalized Compressed Network Search with PyTorch
  ☆26Nov 1, 2017Updated 8 years ago
• jingliao132 / CrossModalRetrieval

  View on GitHub
  Pytorch implementation of 'See, Hear, and Read: Deep Aligned Representations'
  ☆33Dec 17, 2018Updated 7 years ago
• joonson / syncnet_python

  View on GitHub
  Out of time: automated lip sync in the wild
  ☆870Jan 23, 2024Updated 2 years ago
• afourast / deep_lip_reading

  View on GitHub
  Code and models for evaluating a state-of-the-art lip reading network
  ☆196Mar 24, 2023Updated 2 years ago
• cvlab-columbia / oops

  View on GitHub
  Code for Oops! Predicting Unintentional Action in Video
  ☆79Apr 13, 2020Updated 5 years ago
• danmic / av-se

  View on GitHub
  Deep-Learning-Based Audio-Visual Speech Enhancement and Separation
  ☆219Apr 16, 2023Updated 2 years ago
• kuixu / pytorch_online_plotter

  View on GitHub
  Online meter ploter for pytorch. Real time ploting Accuracy, Loss, mAP, AUC, Confusion Matrix
  ☆17Apr 5, 2018Updated 7 years ago
• uzeful / VA_Project

  View on GitHub
  Cross-modality (visual-auditory) Metric Learning Project
  ☆15Dec 19, 2017Updated 8 years ago
• facebookresearch / VisualVoice

  View on GitHub
  Audio-Visual Speech Separation with Cross-Modal Consistency
  ☆246Jul 25, 2023Updated 2 years ago
• DTaoo / Discriminative-Sounding-Objects-Localization

  View on GitHub
  Code for Discriminative Sounding Objects Localization (NeurIPS 2020)
  ☆59Jan 19, 2022Updated 4 years ago
• danpovey / lilcom

  View on GitHub
  Small compression utility
  ☆38Jan 20, 2026Updated 3 weeks ago
• jasongief / PSP_CVPR_2021

  View on GitHub
  [2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line
  ☆42Jul 5, 2022Updated 3 years ago
• raahii / evan

  View on GitHub
  python package to evaluate GANs for video generation
  ☆21Mar 12, 2020Updated 5 years ago