AlexGidiotis / Multimodal-Gesture-Recognition-with-LSTMs-and-CTCLinks
An end-to-end system that performs temporal recognition of gesture sequences using speech and skeletal input. The model combines three networks with a CTC output layer that recognises gestures from continuous stream.
☆29Updated 6 years ago
Alternatives and similar repositories for Multimodal-Gesture-Recognition-with-LSTMs-and-CTC
Users that are interested in Multimodal-Gesture-Recognition-with-LSTMs-and-CTC are comparing it to the libraries listed below
Sorting:
- Multimodal Gesture Recognition Using 3D Convolution and Convolutional LSTM☆92Updated 6 years ago
- Audio-Visual Speech Recognition using Deep Learning☆60Updated 6 years ago
- Multimodal speech recognition using lipreading (with CNNs) and audio (using LSTMs). Sensor fusion is done with an attention network.☆69Updated 2 years ago
- ☆65Updated 6 years ago
- Lip Reading in the Wild using ResNet and LSTMs in PyTorch☆58Updated 7 years ago
- "LipNet: End-to-End Sentence-level Lipreading" in PyTorch☆70Updated 5 years ago
- The proposed method in LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild☆26Updated 6 years ago
- Learning Spatiotemporal Features using 3DCNN and Convolutional LSTM for Gesture Recognition☆62Updated 6 years ago
- DenseNet3D Model In "LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild", https://arxiv.org/abs/1810.069…☆118Updated 4 years ago
- Torch code for using Residual Networks with LSTMs for Lipreading☆98Updated 6 years ago
- Supporting code for "Emotion Recognition in Speech using Cross-Modal Transfer in the Wild"☆103Updated 5 years ago
- SE-Resnet+AMSoftmax for Speaker Verification☆47Updated 6 years ago
- Pytorch implement WaveNet☆93Updated 7 years ago
- tensorflow教程每个章节的源码☆83Updated 2 years ago
- code for Emotion Recognition in the Wild (EmotiW) challenge☆38Updated 6 years ago
- Multi-task learning smile detection, age and gender classification on GENKI4k, IMDB-Wiki dataset.☆179Updated 7 years ago
- convenience utilities for model validation☆23Updated 6 years ago
- An Attention Based Open-Source End to End Speech Synthesis Framework, No CNN, No RNN, No MFCC!!!☆85Updated 4 years ago
- Stochastic Adaptive Neural Architecture Search☆65Updated 6 years ago
- Rewrite the LOUPE library (https://github.com/antoine77340/LOUPE) into Keras version. Many learnable pooling or differentiable aggregatio…☆26Updated 6 years ago
- Repository for Weak Label Learning for Audio Events - A closer look. Uses Audioset subset data provided for reproducibility.☆32Updated last year
- ☆59Updated 7 years ago
- Google Speech Command Dataset Classification Neural Network, CNN, RNN☆25Updated 8 years ago
- Implemented 3 neural network architectures: 1) Combination of RNN LSTM nodes and CNN, 2) CNN with residual blocks similar to ResNet, 3) D…☆25Updated 7 years ago
- Python toolkit for Visual Speech Recognition☆37Updated 5 years ago
- Generalized cross-modal NNs; new audiovisual benchmark (IEEE TNNLS 2019)☆28Updated 5 years ago
- Code for our paper "Acoustic Features Fusion using Attentive Multi-channel Deep Architecture" in Keras and tensorflow☆26Updated 6 years ago
- TristouNet: Triplet Loss for Speaker Turn Embedding☆123Updated 8 years ago
- ☆25Updated 8 years ago
- This is a Chinese version of DeepSpeech2 in torch and its application. Modified from https://github.com/SeanNaren/deepspeech.torch.☆13Updated last year