matthijsvk / multimodalSRLinks
Multimodal speech recognition using lipreading (with CNNs) and audio (using LSTMs). Sensor fusion is done with an attention network.
☆69Updated 2 years ago
Alternatives and similar repositories for multimodalSR
Users that are interested in multimodalSR are comparing it to the libraries listed below
Sorting:
- ☆59Updated 7 years ago
- Supporting code for "Emotion Recognition in Speech using Cross-Modal Transfer in the Wild"☆103Updated 5 years ago
- Repository for Weak Label Learning for Audio Events - A closer look. Uses Audioset subset data provided for reproducibility.☆32Updated last year
- Implementation of the paper "Improved End-to-End Speech Emotion Recognition Using Self Attention Mechanism and Multitask Learning" From I…☆57Updated 4 years ago
- The details that matter: Frequency resolution of spectrograms in acoustic scene classification - paper replication data☆39Updated 7 years ago
- Audio-Visual Speech Recognition using Sequence to Sequence Models☆82Updated 5 years ago
- Audio-Visual Speech Recognition using Deep Learning☆60Updated 6 years ago
- Tensorflow implementation of "Speaker-independent Speech Separation with Deep Attractor Network"☆90Updated 4 years ago
- DCASE 2018 Baseline systems☆129Updated 6 years ago
- Include some core functions and model to handle speech separation☆155Updated 4 years ago
- ☆110Updated 3 years ago
- This code implements a basic MLP for speech recognition. The MLP is trained with pytorch, while feature extraction, alignments, and dec…☆38Updated 7 years ago
- Code for Yun Wang's PhD Thesis: Polyphonic Sound Event Detection with Weak Labeling☆169Updated 3 years ago
- Speech recognition on the TIMIT (or any other) dataset☆43Updated 7 years ago
- Face Landmark-based Speaker-Independent Audio-Visual Speech Enhancement in Multi-Talker Environments☆110Updated last year
- Classification of Urban Sound Audio Dataset using LSTM-based model.☆73Updated 2 years ago
- Feature extraction of speech signal is the initial stage of any speech recognition system.☆94Updated 4 years ago
- A Pytorch implementation of 'AUTOMATIC SPEECH EMOTION RECOGNITION USING RECURRENT NEURAL NETWORKS WITH LOCAL ATTENTION'☆41Updated 7 years ago
- The Additive Margin SincNet (AM-SincNet) is a new approach for speaker recognition problems which is based in the neural network architec…☆45Updated last year
- Deep Learning & 3D Convolutional Neural Networks for Speaker Verification☆122Updated 6 years ago
- Inspired work by the project of SER using ELM at Microsoft Research☆19Updated 7 years ago
- Python toolkit for Visual Speech Recognition☆37Updated 5 years ago
- CTC for emotion recognition☆61Updated 8 years ago
- Repository of code for Speech emotion recognition using voiced speech and attention model, submitted to ICSigSys 2019☆13Updated 5 years ago
- Public repository for the paper "Learning Sound Event Classifiers from Web Audio with Noisy Labels"☆98Updated 6 years ago
- Pytorch code for End-to-End Audiovisual Speech Recognition☆179Updated 2 years ago
- Implement a GRU/LSTM model using Keras, and train it to classify the languages using MFCC features☆25Updated last year
- Adversarial Unsupervised Domain Adaptation for Acoustic Scene Classification☆37Updated 7 years ago
- Tensorflow - Very Deep Convolutional Neural Networks For Raw Waveforms - https://arxiv.org/pdf/1610.00087.pdf☆74Updated 4 years ago
- ☆30Updated 6 years ago