Alternatives and similar repositories for UniVPM

Users that are interested in UniVPM are comparing it to the libraries listed below

• DanielMengLiu / AudioVisualLip
  ☆23Updated last year
• walker-hyf / GPT-Talker
  Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)
  ☆76Updated 11 months ago
• ictnlp / ComSpeech
  Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".
  ☆25Updated last year
• BenoitWang / Speech_Emotion_Diarization
  ☆69Updated last year
• DanielLin94144 / StyleTalk
  Official release of StyleTalk dataset.
  ☆69Updated last year
• HumanMLLM / CoGenAV
  ☆56Updated 3 months ago
• zcxu-eric / AVA-AVD
  ☆47Updated 2 years ago
• chenpk00 / IS2024_stream_decoder_only_asr
  ☆14Updated last year
• yuriak / SpeechDialogueFactory
  ☆37Updated 6 months ago
• Jiaxin-Ye / Emo-DNA
  [ACM MM 2023] Official PyTorch implementation of "Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion Reco…
  ☆11Updated 2 years ago
• ttslr / M2S-ADD
  [InterSpeech'2023] "Betray Oneself: A Novel Audio DeepFake Detection Model via Mono-to-Stereo Conversion"
  ☆13Updated last year
• parrot-tts / Parrot-TTS
  Official Code for ParrotTTS
  ☆55Updated 11 months ago
• cuhealthybrains / MT-LLM
  The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"
  ☆44Updated 5 months ago
• Aisaka0v0 / TS-Whisper
  ☆29Updated 3 months ago
• Li-JEN / PEL-accent-adaptaion
  The offical code of "Parameter-Efficient Learning for Text-to-Speech Accent Adaptation"
  ☆13Updated 2 years ago
• kamepong / StarGAN-VC
  ☆24Updated 3 years ago
• scutcsq / DWFormer
  DWFormer: Dynamic Window Transformer for Speech Emotion Recognition(ICASSP 2023 Oral)
  ☆64Updated last year
• xiaomi-research / dasheng-denoiser
  Official PyTorch inference code for the Interspeech 2025 paper: Efficient Speech Enhancement via Embeddings from Pre-trained Generative A…
  ☆66Updated 3 months ago
• umbertocappellazzo / Llama-AVSR
  [ICASSP 2025] Official Pytorch implementation of "Large Language Models are Strong Audio-Visual Speech Recognition Learners".
  ☆35Updated 3 months ago
• chenqi008 / V2C
  Pytorch implementation for “V2C: Visual Voice Cloning”
  ☆32Updated 2 years ago
• Jiang-Yidi / TS-TalkNet
  INTERSPEECH2023: Target Active Speaker Detection with Audio-visual Cues
  ☆54Updated 2 years ago
• p1an-lin-jung / WavThruVec_pytorch
  An implementation of Charactr, Inc's "WavThruVec: Latent speech representation as intermediate features for neural speech synthesis"
  ☆28Updated 2 years ago
• ahaliassos / raven
  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)
  ☆70Updated 7 months ago
• X-E-Speech / X-E-Speech-code
  X-E-Speech: Joint Training Framework of Non-Autoregressive Cross-lingual Emotional Text-to-Speech and Voice Conversion
  ☆104Updated last year
• 0417keito / PromptTTS2
  [WIP] Unofficial Implementation of Microsoft's PromptTTS2
  ☆52Updated last year
• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆43Updated 11 months ago
• cwang621 / blsp-emo
  BLSP-Emo: Towards Empathetic Large Speech-Language Models
  ☆49Updated last year
• rithiksachdev / PostASR-Correction-SLT2024
  ☆15Updated last year
• ms-dot-k / Lip-to-Speech-Synthesis-in-the-Wild
  PyTorch implementation of "Lip to Speech Synthesis in the Wild with Multi-task Learning" (ICASSP2023)
  ☆71Updated last year
• YuanGongND / llm_speech_emotion_challenge
  ☆21Updated last year