Alternatives and similar repositories for AVSR:

Users that are interested in AVSR are comparing it to the libraries listed below

• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆31Updated last year
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆32Updated 5 months ago
• ms-dot-k / LRW_ID
  The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…
  ☆10Updated last year
• mispchallenge / MISP-ICME-AVSR
  ☆17Updated last year
• ms-dot-k / Visual-Audio-Memory
  PyTorch implementation of "Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video" (ICCV2021)
  ☆20Updated 2 years ago
• choijeongsoo / utut
  [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
  ☆27Updated 5 months ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆53Updated 3 years ago
• mispchallenge / misp2022_baseline
  ☆30Updated last year
• cyjie429 / RawBMamba
  ☆21Updated 7 months ago
• ErosRos / conformer-based-classifier-for-anti-spoofing
  Implementation of "A conformer-based classifier for variable-length utterance processing in anti-spoofing" published in Interspeech 2023.
  ☆23Updated last year
• WWWWxp / Speech-Tokenizer-Papers
  This repository collects papers related to Speech Tokenizer.
  ☆15Updated 4 months ago
• zexupan / USEV
  ☆13Updated 7 months ago
• YUCHEN005 / GILA
  Code for paper "Cross-Modal Global Interaction and Local Alignment for Audio-Visual Speech Recognition"
  ☆19Updated last year
• Exgc / AVMuST-TED
  ☆22Updated 10 months ago
• DataoceanAI / CNVSRC2023Baseline
  Baseline system for CNVSRC2023 (Chinese Continuous Visual Speech Recognition Challenge 2023)
  ☆22Updated 9 months ago
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆62Updated 7 months ago
• TaoRuijie / AVCleanse
  ICASSP 2023: 'Speaker recognition with two-step multi-modal deep cleansing'
  ☆38Updated 2 years ago
• ms-dot-k / Multi-head-Visual-Audio-Memory
  PyTorch implementation of "Distinguishing Homophenes using Multi-Head Visual-Audio Memory" (AAAI2022)
  ☆26Updated 11 months ago
• ductuantruong / tcm_add
  Official implementation of the INTERSPEECH 2024 paper: Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detect…
  ☆35Updated 2 months ago
• YasserdahouML / VSR_test_set
  WildVSR
  ☆15Updated last year
• Levent9 / Zero-shot-FaceVC
  ☆17Updated 11 months ago
• JuanFMontesinos / VoViT
  VoViT: Low Latency Graph-based Audio-Visual VoiceSeparation Transformer
  ☆34Updated last year
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆30Updated 2 years ago
• sony / CLIPSep
  ☆37Updated 2 years ago
• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆27Updated 3 months ago
• HappyColor / Vesper
  A Compact and Effective Pretrained Model for Speech Emotion Recognition
  ☆32Updated 7 months ago
• skakouros / s3prl_attentive_correlation
  Self-Supervised Speech/Sound Pre-training and Representation Learning Toolkit
  ☆13Updated 2 years ago
• HappyColor / SpeechFormer
  Official implement of SpeechFormer written in Python (PyTorch).
  ☆77Updated last year
• X-LANCE / MSDWILD
  [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
  ☆47Updated last year
• zaocan666 / DyViSE
  Dynamic vision-guided speaker embedding for audio-visual speaker diarization
  ☆11Updated 2 years ago