Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL 2022)
☆68Jul 13, 2022Updated 4 years ago
Alternatives and similar repositories for Leveraging-Self-Supervised-Learning-for-AVSR
Users that are interested in Leveraging-Self-Supervised-Learning-for-AVSR are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch implementation of "Distinguishing Homophenes using Multi-Head Visual-Audio Memory" (AAAI2022)☆27Mar 9, 2024Updated 2 years ago
- A PyTorch implementation of the Deep Audio-Visual Speech Recognition paper.☆245Feb 15, 2024Updated 2 years ago
- Visual Speech Recognition for Multiple Languages☆485Aug 17, 2023Updated 3 years ago
- repository for paper "Audio-Visual Speech Recognition in MISP2021 Challenge: Dataset Release and Deep Analysis"☆18Jun 17, 2022Updated 4 years ago
- [WACV 2023] Audio-Visual Efficient Conformer (AVEC) for Robust Speech Recognition☆101Feb 21, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- TF code for our CVPR2020 paper "Discriminative Multi-modality Speech Recognition"☆26Apr 27, 2022Updated 4 years ago
- A self-supervised learning framework for audio-visual speech☆994Dec 7, 2023Updated 2 years ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆82Feb 27, 2025Updated last year
- Official vLLM evaluation for OLMo and NCP-ArchPreview: GSM8K, SciQ, Core88, RULER, and HELMET☆27Sep 11, 2026Updated last month
- The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…☆10Oct 12, 2023Updated 3 years ago
- ☆14Oct 7, 2021Updated 5 years ago
- PyTorch implementation of "Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video" (ICCV2021)☆22Apr 11, 2022Updated 4 years ago
- Official Implementation of Visual Transformer Pooling for Lip reading☆41Aug 8, 2022Updated 4 years ago
- ☆24Mar 30, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The PyTorch Code and Model In "Learn an Effective Lip Reading Model without Pains", (https://arxiv.org/abs/2011.07557), which reaches the…☆169Sep 12, 2025Updated last year
- Pytorch code for End-to-End Audiovisual Speech Recognition☆182Nov 18, 2022Updated 3 years ago
- The official implementation of the paper "MemSFT: Mitigating Alignment Tax with an External Parametric Memory".☆28Aug 3, 2026Updated 3 months ago
- Code repository for the Cantonese In-car Audio-Visual Speech Recognition (CI-AVSR) dataset.☆42Jul 16, 2024Updated 2 years ago
- Code for InterSpeech 2024 Paper: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition☆20Jul 16, 2024Updated 2 years ago
- [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization☆62Mar 26, 2025Updated last year
- Official implementation of the paper "PonderLM-2: Pretraining LLM with Latent Thoughts in Continuous Space"☆18May 6, 2026Updated 5 months ago
- Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…☆36Jun 20, 2023Updated 3 years ago
- ☆11Jan 31, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- wake-up word emotion recognition [APSIPA 2022]☆17Nov 11, 2022Updated 3 years ago
- Transformer-based online speech recognition system with TensorFlow 2☆26Jan 22, 2021Updated 5 years ago
- ICASSP'22 Training Strategies for Improved Lip-Reading; ICASSP'21 Towards Practical Lipreading with Distilled and Efficient Models; ICASS…☆436May 18, 2023Updated 3 years ago
- Audio-Visual Speech Recognition☆24Jul 7, 2025Updated last year
- awesome-audio-visual-robustness☆12Jan 27, 2024Updated 2 years ago
- ViSpeR: Multilingual Audio-Visual Speech Recognition☆61Apr 17, 2025Updated last year
- Huggingface Implementation of AV-HuBERT on the MuAViC Dataset☆18Mar 6, 2025Updated last year
- A curated list of audio-visual learning methods and datasets.☆296Dec 3, 2024Updated last year
- ☆18Nov 22, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆15Dec 11, 2021Updated 4 years ago
- ☆11Oct 24, 2022Updated 4 years ago
- Source code and speech samples for the DSU-AVO paper accepted to INTERSPEECH 2023☆12May 13, 2024Updated 2 years ago
- Official Pytorch implementation of "Large Language Models are Strong Audio-Visual Speech Recognition Learners" [ICASSP 2025] and "Mitigat…☆68Jan 18, 2026Updated 9 months ago
- Multi-Task Speech classification of accent and gender of an english speaker on Mozilla's common voice dataset☆27Jul 17, 2026Updated 3 months ago
- Promting Whisper for Audio-Visual Speech Recognition, Code-Switched Speech Recognition, and Zero-Shot Speech Translation☆153Jan 16, 2024Updated 2 years ago
- A Pytorch implementation of the paper : SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classification☆34Jun 25, 2021Updated 5 years ago