andrewowens / multisensory
Code for the paper: Audio-Visual Scene Analysis with Self-Supervised Multisensory Features
☆220Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for multisensory
- Unofficial Implementation of Google Deepmind's paper `Objects that Sound`☆83Updated 6 years ago
- 2.5D visual sound dataset☆92Updated 3 years ago
- Co-Separating Sounds of Visual Objects (ICCV 2019)☆94Updated last year
- Torch code for using Residual Networks with LSTMs for Lipreading☆99Updated 6 years ago
- Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"☆111Updated 4 years ago
- 2.5D visual sound☆110Updated last year
- TensorFlow implementation of "SoundNet".☆145Updated 6 years ago
- Learning to Separate Object Sounds by Watching Unlabeled Video (ECCV 2018)☆49Updated 5 years ago
- Codebase and Dataset for the paper: Learning to Localize Sound Source in Visual Scenes☆84Updated 3 years ago
- Audio-Visual Speech Recognition using Deep Learning☆59Updated 6 years ago
- My experiments in lip reading using deep learning with the LRW dataset☆51Updated 3 years ago
- Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)☆127Updated 3 years ago
- AVSpeech downloader☆66Updated 5 years ago
- Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018☆172Updated 3 years ago
- Deep Audio-Visual Embedding network (DAVEnet) implementation in PyTorch☆63Updated 6 years ago
- Codebase for the paper "Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation" (ECCV2020)☆68Updated 4 years ago
- Wavenet Autoencoder for Unsupervised speech representation learning (after Chorowski, Jan 2019)☆174Updated 4 years ago
- processing and extracting of face and mouth image files out of the TCDTIMIT database☆44Updated 4 years ago
- VGGSound: A Large-scale Audio-Visual Dataset☆291Updated 3 years ago
- Include some core functions and model to handle speech separation☆155Updated 3 years ago
- AlignNet: A Unifying Approach to Audio-Visual Alignment (WACV 2020)☆31Updated 3 years ago
- Audio Visual Instance Discrimination with Cross-Modal Agreement☆127Updated 3 years ago
- Code for Vision-Infused Deep Audio Inpainting (ICCV 2019)☆56Updated 5 years ago
- Speech-conditioned face generation using Generative Adversarial Networks☆87Updated last year
- Lip Reading in the Wild using ResNet and LSTMs in PyTorch☆58Updated 6 years ago
- Localizing Visual Sounds the Hard Way☆78Updated 2 years ago
- ☆58Updated 6 years ago
- Python toolkit for Visual Speech Recognition☆37Updated 4 years ago