Alternatives and similar repositories for multisensory

Users that are interested in multisensory are comparing it to the libraries listed below

• tstafylakis / Lipreading-ResNet
  Torch code for using Residual Networks with LSTMs for Lipreading
  ☆98Updated 6 years ago
• rohitrango / objects-that-sound
  Unofficial Implementation of Google Deepmind's paper `Objects that Sound`
  ☆83Updated 7 years ago
• facebookresearch / FAIR-Play
  2.5D visual sound dataset
  ☆99Updated 3 years ago
• facebookresearch / 2.5D-Visual-Sound
  2.5D visual sound
  ☆115Updated last year
• afourast / avobjects
  Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"
  ☆113Updated 4 years ago
• changil / avspeech-downloader
  AVSpeech downloader
  ☆67Updated 6 years ago
• rhgao / co-separation
  Co-Separating Sounds of Visual Objects (ICCV 2019)
  ☆95Updated last year
• matthijsvk / TCDTIMITprocessing
  processing and extracting of face and mouth image files out of the TCDTIMIT database
  ☆45Updated 4 years ago
• ajinkyaT / Lip_Reading_in_the_Wild_AVSR
  Audio-Visual Speech Recognition using Deep Learning
  ☆60Updated 6 years ago
• eborboihuc / SoundNet-tensorflow
  TensorFlow implementation of "SoundNet".
  ☆145Updated 7 years ago
• facebookarchive / Audio2BodyDynamics
  Audio To Body Dynamics, CVPR 2018
  ☆118Updated 6 years ago
• euancrabtree / Lipreading-PyTorch
  Lip Reading in the Wild using ResNet and LSTMs in PyTorch
  ☆58Updated 7 years ago
• facebookresearch / Listen-to-Look
  Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)
  ☆130Updated 3 years ago
• dharwath / DAVEnet-pytorch
  Deep Audio-Visual Embedding network (DAVEnet) implementation in PyTorch
  ☆65Updated 6 years ago
• rhgao / Deep-MIML-Network
  Learning to Separate Object Sounds by Watching Unlabeled Video (ECCV 2018)
  ☆51Updated 5 years ago
• oawiles / FAb-Net
  Pytorch code for BMVC 2018 paper
  ☆87Updated 5 years ago
• miqueltubau / Wav2Pix
  Speech-conditioned face generation using Generative Adversarial Networks
  ☆88Updated 2 years ago
• georgesterpu / avsr-tf1
  Audio-Visual Speech Recognition using Sequence to Sequence Models
  ☆82Updated 4 years ago
• bill9800 / speech_separation
  Include some core functions and model to handle speech separation
  ☆155Updated 3 years ago
• zfang399 / AlignNet
  AlignNet: A Unifying Approach to Audio-Visual Alignment (WACV 2020)
  ☆33Updated 4 years ago
• anuragkr90 / weak_feature_extractor
  ☆59Updated 7 years ago
• georgesterpu / pyVSR
  Python toolkit for Visual Speech Recognition
  ☆37Updated 4 years ago
• cyrta / voxceleb
  mirror of VoxCeleb dataset - a large-scale speaker identification dataset
  ☆71Updated 5 years ago
• cvondrick / soundnet
  SoundNet: Learning Sound Representations from Unlabeled Video. NIPS 2016
  ☆462Updated 7 years ago
• YapengTian / AVE-ECCV18
  Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018
  ☆185Updated 4 years ago
• arielephrat / vid2speech
  Code for "Vid2speech: Speech Reconstruction from Silent Video" ICASSP '17
  ☆116Updated 8 years ago
• mpc001 / end-to-end-lipreading
  Pytorch code for End-to-End Audiovisual Speech Recognition
  ☆177Updated 2 years ago
• SheldonTsui / SepStereo_ECCV2020
  Codebase for the paper "Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation" (ECCV2020)
  ☆72Updated 4 years ago
• Hangz-nju-cuhk / Vision-Infused-Audio-Inpainter-VIAI
  Code for Vision-Infused Deep Audio Inpainting (ICCV 2019)
  ☆57Updated 5 years ago
• swasun / VQ-VAE-Speech
  PyTorch implementation of VQ-VAE + WaveNet by [Chorowski et al., 2019] and VQ-VAE on speech signals by [van den Oord et al., 2017]
  ☆269Updated 5 years ago