Alternatives and similar repositories for multisensory:

Users that are interested in multisensory are comparing it to the libraries listed below

• rohitrango / objects-that-sound
  Unofficial Implementation of Google Deepmind's paper `Objects that Sound`
  ☆83Updated 6 years ago
• facebookresearch / FAIR-Play
  2.5D visual sound dataset
  ☆97Updated 3 years ago
• rhgao / co-separation
  Co-Separating Sounds of Visual Objects (ICCV 2019)
  ☆94Updated last year
• afourast / avobjects
  Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"
  ☆113Updated 4 years ago
• dharwath / DAVEnet-pytorch
  Deep Audio-Visual Embedding network (DAVEnet) implementation in PyTorch
  ☆65Updated 6 years ago
• tstafylakis / Lipreading-ResNet
  Torch code for using Residual Networks with LSTMs for Lipreading
  ☆98Updated 6 years ago
• rhgao / Deep-MIML-Network
  Learning to Separate Object Sounds by Watching Unlabeled Video (ECCV 2018)
  ☆49Updated 5 years ago
• facebookresearch / Listen-to-Look
  Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)
  ☆129Updated 3 years ago
• facebookresearch / 2.5D-Visual-Sound
  2.5D visual sound
  ☆114Updated last year
• YapengTian / AVE-ECCV18
  Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018
  ☆181Updated 4 years ago
• changil / avspeech-downloader
  AVSpeech downloader
  ☆67Updated 6 years ago
• ajinkyaT / Lip_Reading_in_the_Wild_AVSR
  Audio-Visual Speech Recognition using Deep Learning
  ☆60Updated 6 years ago
• eborboihuc / SoundNet-tensorflow
  TensorFlow implementation of "SoundNet".
  ☆145Updated 7 years ago
• bill9800 / speech_separation
  Include some core functions and model to handle speech separation
  ☆155Updated 3 years ago
• euancrabtree / Lipreading-PyTorch
  Lip Reading in the Wild using ResNet and LSTMs in PyTorch
  ☆58Updated 7 years ago
• oawiles / FAb-Net
  Pytorch code for BMVC 2018 paper
  ☆87Updated 5 years ago
• hrbigelow / ae-wavenet
  Wavenet Autoencoder for Unsupervised speech representation learning (after Chorowski, Jan 2019)
  ☆175Updated 4 years ago
• ardasnck / learning_to_localize_sound_source
  Codebase and Dataset for the paper: Learning to Localize Sound Source in Visual Scenes
  ☆90Updated 4 months ago
• qiuqiangkong / audioset_classification
  ☆226Updated 5 years ago
• matthijsvk / TCDTIMITprocessing
  processing and extracting of face and mouth image files out of the TCDTIMIT database
  ☆45Updated 4 years ago
• albanie / mcnCrossModalEmotions
  Supporting code for "Emotion Recognition in Speech using Cross-Modal Transfer in the Wild"
  ☆101Updated 5 years ago
• ekazakos / temporal-binding-network
  Implementation of "EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognition, ICCV, 2019" in PyTorch
  ☆111Updated 4 years ago
• hche11 / Localizing-Visual-Sounds-the-Hard-Way
  Localizing Visual Sounds the Hard Way
  ☆79Updated 2 years ago
• facebookresearch / AVID-CMA
  Audio Visual Instance Discrimination with Cross-Modal Agreement
  ☆128Updated 3 years ago
• roudimit / MUSIC_dataset
  MUSIC Dataset from The Sound of Pixels (ECCV '18)
  ☆123Updated 2 years ago
• anuragkr90 / weak_feature_extractor
  ☆58Updated 7 years ago
• jingliao132 / CrossModalRetrieval
  Pytorch implementation of 'See, Hear, and Read: Deep Aligned Representations'
  ☆33Updated 6 years ago
• hangzhaomit / Sound-of-Pixels
  Codebase for ECCV18 "The Sound of Pixels"
  ☆378Updated 2 years ago
• fuankarion / active-speakers-context
  Code for the Active Speakers in Context Paper (CVPR2020)
  ☆54Updated 3 years ago
• DTaoo / Discriminative-Sounding-Objects-Localization
  Code for Discriminative Sounding Objects Localization (NeurIPS 2020)
  ☆57Updated 3 years ago