Alternatives and similar repositories for Personalized-Lip-Reading:

Users that are interested in Personalized-Lip-Reading are comparing it to the libraries listed below

• JeongHun0716 / zero-avsr
  Official PyTorch implementation for "Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech …
  ☆19Updated 2 weeks ago
• JeongHun0716 / vsr-low
  Visual Speech Recognition For Low-Resource Languages with Automatic Labels (ICASSP 2024)
  ☆13Updated 2 weeks ago
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆34Updated 6 months ago
• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆32Updated last year
• choijeongsoo / utut
  [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
  ☆29Updated 6 months ago
• ms-dot-k / AVSR
  PyTorch implementation of "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scorin…
  ☆15Updated last year
• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆31Updated 5 months ago
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆63Updated last month
• KAIST-AILab / SyncVSR
  [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization
  ☆48Updated last week
• X-LANCE / MSDWILD
  [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
  ☆50Updated last year
• JeongHun0716 / e-mvsr
  Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation (ACM MM 2024)
  ☆16Updated 2 weeks ago
• ms-dot-k / LRW_ID
  The speaker-labeled information of LRW dataset, which is the outcome of the paper "Speaker-adaptive Lip Reading with User-dependent Paddi…
  ☆10Updated last year
• ahaliassos / usr
  Official implementation of USR (NeurIPS 2024)
  ☆29Updated 3 months ago
• thuhcsi / SECap
  ☆160Updated 8 months ago
• EMOsuperb / EMO-SUPERB-submission
  EMO-SUPERB submission
  ☆42Updated 6 months ago
• JeongHun0716 / MMS-LLaMA
  Official PyTorch implementation for "MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens…
  ☆19Updated this week
• joannahong / Lip2Wav-pytorch
  a PyTorch implementation of Lip2Wav
  ☆50Updated 2 years ago
• ByungKwanLee / YOLO-Dyanmic-ROS
  Modification to YOLO for improving Dynamic Real-Time Processing on Robotics Operating Systems for Autonomous Vehicle System
  ☆21Updated 3 years ago
• ms-dot-k / Visual-Context-Attentional-GAN
  PyTorch implementation of "Lip to Speech Synthesis with Visual Context Attentional GAN" (NeurIPS2021)
  ☆23Updated last year
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆51Updated 11 months ago
• usc-sail / peft-ser
  PEFT-SER: On the Use of Parameter Efficient Transfer Learning Approaches For Speech Emotion Recognition Using Pre-trained Speech Models (…
  ☆59Updated 9 months ago
• sunlicai / HiCMAE
  [Information Fusion 2024] HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition
  ☆100Updated 5 months ago
• john852517791 / awesome-fake-audio-detection
  A list of tools, papers and code related to Fake Audio Detection.
  ☆77Updated last week
• GalaxyCong / StyleDubber
  [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"
  ☆81Updated 4 months ago
• Levent9 / Zero-shot-FaceVC
  ☆18Updated last year
• sinhat98 / adapter-wavlm
  ☆43Updated 2 years ago
• thuhcsi / SpeechCraft
  The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
  ☆113Updated 3 months ago
• ECNU-Cross-Innovation-Lab / ENT
  [ICASSP 2024] Emotion Neural Transducer for Fine-Grained Speech Emotion Recognition
  ☆22Updated 11 months ago
• emo-box / EmoBox
  [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark
  ☆217Updated 9 months ago
• Sreyan88 / MMER
  Code for the InterSpeech 2023 paper: MMER: Multimodal Multi-task learning for Speech Emotion Recognition
  ☆72Updated last year