Alternatives and similar repositories for AVSR:

Users that are interested in AVSR are comparing it to the libraries listed below

• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆32Updated last year
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆34Updated 6 months ago
• ms-dot-k / LRW_ID
  The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…
  ☆10Updated last year
• david-gimeno / tailored-avsr
  Official source code for the paper "Tailored Design of Audio-Visual Speech Recognition Models using Branchformers"
  ☆11Updated last month
• mispchallenge / MISP-ICME-AVSR
  ☆17Updated last year
• DataoceanAI / CNVSRC2023Baseline
  Baseline system for CNVSRC2023 (Chinese Continuous Visual Speech Recognition Challenge 2023)
  ☆22Updated 11 months ago
• JeongHun0716 / vsr-low
  Visual Speech Recognition For Low-Resource Languages with Automatic Labels (ICASSP 2024)
  ☆13Updated last week
• ms-dot-k / Visual-Audio-Memory
  PyTorch implementation of "Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video" (ICCV2021)
  ☆20Updated 2 years ago
• choijeongsoo / utut
  [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
  ☆29Updated 6 months ago
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆63Updated last month
• mispchallenge / misp2022_baseline
  ☆30Updated last year
• TaoRuijie / AVCleanse
  ICASSP 2023: 'Speaker recognition with two-step multi-modal deep cleansing'
  ☆39Updated 2 years ago
• YasserdahouML / VSR_test_set
  WildVSR
  ☆15Updated last year
• ErosRos / conformer-based-classifier-for-anti-spoofing
  Implementation of "A conformer-based classifier for variable-length utterance processing in anti-spoofing" published in Interspeech 2023.
  ☆23Updated last year
• zexupan / USEV
  ☆13Updated 8 months ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆54Updated 3 years ago
• ductuantruong / tcm_add
  Official implementation of the INTERSPEECH 2024 paper: Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detect…
  ☆36Updated 3 months ago
• prajwalkr / transpotter
  Official implementation of Transpotter, published in BMVC 2021
  ☆16Updated 2 years ago
• YUCHEN005 / GILA
  Code for paper "Cross-Modal Global Interaction and Local Alignment for Audio-Visual Speech Recognition"
  ☆19Updated last year
• msplabresearch / MSP-Podcast_Challenge_IS2025
  MSP-Podcast Challenge Baseline Code for Interspeech 2025
  ☆22Updated 3 months ago
• WWWWxp / Speech-Tokenizer-Papers
  This repository collects papers related to Speech Tokenizer.
  ☆15Updated 5 months ago
• zexupan / MuSE
  ☆32Updated 4 months ago
• cyjie429 / RawBMamba
  ☆23Updated 8 months ago
• Exgc / AVMuST-TED
  ☆22Updated last year
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• TaoRuijie / MFV-KSD
  Multi-Stage Face-Voice Association Learning with Keynote Speaker Diarization (ACM MM 2024)
  ☆18Updated 8 months ago
• talkingnow / HM-Conformer
  ☆27Updated last year
• JeongHun0716 / e-mvsr
  Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)
  ☆16Updated last week
• AlanBaade / MAE-AST-Public
  Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer
  ☆87Updated 2 years ago
• JunyiPeng00 / SLT22_MultiHead-Factorized-Attentive-Pooling
  An attention-based backend allowing efficient fine-tuning of transformer models for speaker verification
  ☆20Updated 6 months ago