Alternatives and similar repositories for AVSR

Users that are interested in AVSR are comparing it to the libraries listed below

• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆33Updated last year
• zxzhao0 / C2SER
  We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…
  ☆30Updated 3 months ago
• mispchallenge / MISP-ICME-AVSR
  ☆17Updated last year
• choijeongsoo / utut
  [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
  ☆30Updated 8 months ago
• HappyColor / Vesper
  A Compact and Effective Pretrained Model for Speech Emotion Recognition
  ☆39Updated 11 months ago
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆36Updated 8 months ago
• ductuantruong / tcm_add
  Official implementation of the INTERSPEECH 2024 paper: Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detect…
  ☆38Updated 6 months ago
• mispchallenge / misp2022_baseline
  ☆30Updated last year
• ms-dot-k / TMT
  TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages
  ☆15Updated last year
• XinhaoMei / audio-text_retrieval
  Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'
  ☆45Updated 3 years ago
• sungnyun / avsr-temporal-dynamics
  (SLT 2024) Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech Recognition
  ☆12Updated 7 months ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆53Updated 3 years ago
• zexupan / USEV
  ☆13Updated 11 months ago
• ta012 / SSLAM
  [ICLR 2025] Enhancing Self-Supervised Models with Audio Mixtures for Polyphonic Soundscapes
  ☆39Updated 3 weeks ago
• ErosRos / conformer-based-classifier-for-anti-spoofing
  Implementation of "A conformer-based classifier for variable-length utterance processing in anti-spoofing" published in Interspeech 2023.
  ☆23Updated last year
• david-gimeno / tailored-avsr
  Official source code for the paper "Tailored Design of Audio-Visual Speech Recognition Models using Branchformers"
  ☆12Updated 3 months ago
• YUCHEN005 / Gradient-Remedy
  Code for paper "Gradient Remedy for Multi-Task Learning in End-to-End Noise-Robust Speech Recognition"
  ☆19Updated 2 years ago
• talkingnow / HM-Conformer
  ☆27Updated last year
• haoheliu / diffres-python
  Learning differentiable temporal resolution on time-series data.
  ☆36Updated 2 years ago
• cyjie429 / RawBMamba
  ☆25Updated 10 months ago
• CPJKU / cpjku_dcase24
  ☆24Updated 7 months ago
• TaoRuijie / AVCleanse
  ICASSP 2023: 'Speaker recognition with two-step multi-modal deep cleansing'
  ☆41Updated 2 years ago
• Exgc / AVMuST-TED
  ☆23Updated last year
• ETZET / SpeechEmotionAVLearning
  ☆12Updated last year
• ECNU-Cross-Innovation-Lab / ENT
  [ICASSP 2024] Emotion Neural Transducer for Fine-Grained Speech Emotion Recognition
  ☆23Updated last year
• JeongHun0716 / vsr-low
  Visual Speech Recognition For Low-Resource Languages with Automatic Labels (ICASSP 2024)
  ☆14Updated 2 months ago
• ms-dot-k / LRW_ID
  The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…
  ☆10Updated last year
• Labbeti / conette-audio-captioning
  CoNeTTE: An efficient Audio Captioning system leveraging multiple datasets with Task Embedding
  ☆19Updated 5 months ago
• YUCHEN005 / GILA
  Code for paper "Cross-Modal Global Interaction and Local Alignment for Audio-Visual Speech Recognition"
  ☆19Updated last year
• msplabresearch / MSP-Podcast_Challenge_IS2025
  MSP-Podcast Challenge Baseline Code for Interspeech 2025
  ☆24Updated 5 months ago