JackSyu / Discriminative-Multi-modality-Speech-RecognitionView external linksLinks
TF code for our CVPR2020 paper "Discriminative Multi-modality Speech Recognition"
☆26Apr 27, 2022Updated 3 years ago
Alternatives and similar repositories for Discriminative-Multi-modality-Speech-Recognition
Users that are interested in Discriminative-Multi-modality-Speech-Recognition are comparing it to the libraries listed below
Sorting:
- ☆15Dec 11, 2021Updated 4 years ago
- Code and model for paper <Mutual Information Maximization for Effective Lip Reading>☆19Sep 4, 2020Updated 5 years ago
- pytorch CTC implementation for ASR. Use eesen's fst decoder framework☆10Feb 27, 2020Updated 5 years ago
- The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…☆10Oct 12, 2023Updated 2 years ago
- An unofficial (PyTorch) implementation for the paper Deep Lip Reading: A comparison of models and an online application.☆10May 13, 2020Updated 5 years ago
- End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.☆10Jan 21, 2022Updated 4 years ago
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆431May 18, 2023Updated 2 years ago
- PyTorch implementation of "Distinguishing Homophenes using Multi-Head Visual-Audio Memory" (AAAI2022)☆27Mar 9, 2024Updated last year
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆242Feb 15, 2024Updated 2 years ago
- ☆14Oct 7, 2021Updated 4 years ago
- AudioVisual Diarization - Supervised and Unsupervised☆15Nov 22, 2022Updated 3 years ago
- Seeing Wake Words: Audio-visual Keyword Spotting☆66Sep 16, 2020Updated 5 years ago
- Torch code for using Residual Networks with LSTMs for Lipreading☆99Oct 8, 2018Updated 7 years ago
- Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL…☆68Jul 13, 2022Updated 3 years ago
- Official implementation of Transpotter, published in BMVC 2021☆16Aug 6, 2022Updated 3 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆26Updated this week
- Baseline system for CNVSRC2023 (Chinese Continuous Visual Speech Recognition Challenge 2023)☆22Apr 27, 2024Updated last year
- Official Implementation of Visual Transformer Pooling for Lip reading☆40Aug 8, 2022Updated 3 years ago
- Audio-Visual Speech Recognition using Sequence to Sequence Models☆83Jul 10, 2020Updated 5 years ago
- Test-time adaptation for speech recognition model by single utterance. The official implementation of "Listen, Adapt, Better WER: Source-…☆20Apr 1, 2022Updated 3 years ago
- ☆18Aug 9, 2018Updated 7 years ago
- DenseNet3D Model In "LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild", https://arxiv.org/abs/1810.069…☆118Dec 10, 2020Updated 5 years ago
- Deep Neural Network for joint emotion classification and landmark localization.☆21Apr 2, 2019Updated 6 years ago
- ☆24Mar 13, 2020Updated 5 years ago
- Pytorch code for End-to-End Audiovisual Speech Recognition☆184Nov 18, 2022Updated 3 years ago
- Sound Source Localization for AI Grand Challenge 2021☆21Feb 7, 2022Updated 4 years ago
- Speech Recognition without audio input☆142Jan 14, 2019Updated 7 years ago
- ☆30Oct 29, 2024Updated last year
- Repo for the FB AI Speech team.☆25Aug 24, 2021Updated 4 years ago
- Decoders from Kaldi using OpenFst☆34Jan 29, 2026Updated 2 weeks ago
- ☆25Aug 2, 2024Updated last year
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Aug 2, 2021Updated 4 years ago
- Audio-Visual Speech Recognition using Deep Learning☆61Nov 14, 2018Updated 7 years ago
- The PyTorch Code and Model In "Learn an Effective Lip Reading Model without Pains", (https://arxiv.org/abs/2011.07557), which reaches the…☆165Sep 12, 2025Updated 5 months ago
- ☆28Dec 22, 2021Updated 4 years ago
- ☆29Jun 15, 2022Updated 3 years ago
- Visual Speech Recognition for Multiple Languages☆458Aug 17, 2023Updated 2 years ago
- A Pytorch implementation of the paper : SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classification☆34Jun 25, 2021Updated 4 years ago
- Reranking for Multi-objective Optimized Recommender Systems☆11Aug 3, 2023Updated 2 years ago