AlexGidiotis / Multimodal-Gesture-Recognition-with-LSTMs-and-CTC
An end-to-end system that performs temporal recognition of gesture sequences using speech and skeletal input. The model combines three networks with a CTC output layer that recognises gestures from continuous stream.
☆28Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for Multimodal-Gesture-Recognition-with-LSTMs-and-CTC
- Multimodal Gesture Recognition Using 3D Convolution and Convolutional LSTM☆91Updated 5 years ago
- code for Emotion Recognition in the Wild (EmotiW) challenge☆37Updated 5 years ago
- Random regression forests for audio event detection☆9Updated 7 years ago
- Learning Spatiotemporal Features using 3DCNN and Convolutional LSTM for Gesture Recognition☆61Updated 5 years ago
- Audio Visual Speech Recognition☆22Updated 7 years ago
- Multimodal speech recognition using lipreading (with CNNs) and audio (using LSTMs). Sensor fusion is done with an attention network.☆66Updated 2 years ago
- The proposed method in LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild☆25Updated 5 years ago
- A Novel and Efficient CVAE-GAN-BASED Approach with Informative Manifold for Semi-Supervised Anomaly Detection☆13Updated 5 years ago
- Generalized cross-modal NNs; new audiovisual benchmark (IEEE TNNLS 2019)☆25Updated 4 years ago
- Audio-Visual Speech Recognition using Deep Learning☆59Updated 6 years ago
- Video classification using the UCF101 dataset for action recognition. We extract SIFT, MFCC and STIP features from the videos, we encode …☆28Updated 3 years ago
- Stochastic Adaptive Neural Architecture Search☆66Updated 6 years ago
- ☆58Updated 6 years ago
- Code for the paper: Audio-Visual Model Distillation Using Acoustic Images☆20Updated last year
- ☆25Updated 7 years ago
- convenience utilities for model validation☆23Updated 5 years ago
- The details that matter: Frequency resolution of spectrograms in acoustic scene classification - paper replication data☆38Updated 6 years ago
- ☆18Updated 7 years ago
- Keras implementation of a LCRN (CNN+LSTM) based Speed Predictor from Dashcam video data.☆7Updated 7 years ago
- Adversarial Unsupervised Domain Adaptation for Acoustic Scene Classification☆35Updated 6 years ago
- (new updates have been moved to a private repo)☆8Updated 6 years ago
- facial expression face recognition object detect Paper and books☆23Updated 6 years ago
- Google Speech Command Dataset Classification Neural Network, CNN, RNN☆24Updated 7 years ago
- Method strategy for EmotiW 2017 video emotion recognition☆35Updated 7 years ago
- Torch code for using Residual Networks with LSTMs for Lipreading☆99Updated 6 years ago
- Lip Reading in the Wild using ResNet and LSTMs in PyTorch☆58Updated 6 years ago
- PyTorch-based Driver Posture Classification☆29Updated 6 years ago
- Repository for Weak Label Learning for Audio Events - A closer look. Uses Audioset subset data provided for reproducibility.☆32Updated last year
- A tensorflow implementation of the R3DCNN network by Molchanov (2016).☆10Updated 7 years ago