Alternatives and similar repositories for CoGenAV

Users that are interested in CoGenAV are comparing it to the libraries listed below

• GalaxyCong / EmoDubber
  Official source codes for the paper: EmoDubber: Towards High Quality and Emotion Controllable Movie Dubbing.
  ☆33Updated 7 months ago
• KAIST-AILab / SyncVSR
  [Interspeech 2024] SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization
  ☆60Updated 9 months ago
• FreedomIntelligence / EchoX
  EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs
  ☆46Updated 4 months ago
• X-LANCE / VQTalker
  [AAAI 2025] VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization
  ☆53Updated last year
• Haoqiu-Yan / PerceptiveAgent
  Code for Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction (ACL24))
  ☆49Updated last year
• ariesssxu / vta-ldm
  ☆62Updated 7 months ago
• CASIA-LM / OpenS2S
  OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model
  ☆103Updated 6 months ago
• FreedomIntelligence / FusionAudio
  Towards Fine-grained Audio Captioning with Multimodal Contextual Cues
  ☆86Updated 2 weeks ago
• XiaomiMiMo / MiMo-Audio-Eval
  ☆76Updated 3 months ago
• EIT-NLP / LLaSO
  ☆112Updated 3 months ago
• Jiang-Yidi / TS-TalkNet
  INTERSPEECH2023: Target Active Speaker Detection with Audio-visual Cues
  ☆57Updated 2 years ago
• klingfoley / Kling-Foley
  Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
  ☆63Updated 6 months ago
• VITA-MLLM / LUCY
  LUCY: Linguistic Understanding and Control Yielding Early Stage of Her
  ☆58Updated 9 months ago
• snap-research / GenAU
  ☆47Updated 9 months ago
• heng-hw / V2A-Mapper
  [AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models
  ☆27Updated 2 years ago
• shivammehta25 / Diff-TTSG
  Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis
  ☆40Updated 2 years ago
• yuriak / SpeechDialogueFactory
  ☆38Updated 9 months ago
• yynil / RWKVTTS
  This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).
  ☆92Updated 3 months ago
• XiaomiMiMo / MiMo-Audio-Tokenizer
  A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.
  ☆131Updated 4 months ago
• bytedance / video-SALMONN-2
  video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…
  ☆141Updated last month
• jdh-algo / JoyTTS
  ☆41Updated 6 months ago
• SJTUwxz / LoCoNet_ASD
  code repo for LoCoNet: Long-Short Context Network for Active Speaker Detection
  ☆46Updated 2 years ago
• JeongHun0716 / MMS-LLaMA
  Official PyTorch implementation for "MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens…
  ☆44Updated 7 months ago
• choijeongsoo / lip2speech-unit
  [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
  ☆47Updated last year
• YasserdahouML / visper
  ViSpeR: Multilingual Audio-Visual Speech Recognition
  ☆54Updated 9 months ago
• bytedance / Make-An-Audio-2
  a text-conditional diffusion probabilistic model capable of generating high fidelity audio.
  ☆188Updated last year
• ddlBoJack / Omni-Captioner
  Data Pipeline, Models, and Benchmark for Omni-Captioner.
  ☆115Updated 3 months ago
• YUCHEN005 / UniVPM
  Code for paper "Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition"
  ☆28Updated 2 years ago
• plnguyen2908 / LASER_ASD
  [WACV 2026] LASER: Lip Landmark Assisted Speaker Detection for Robustness official implemntation
  ☆20Updated last month
• GalaxyCong / HPMDubbing
  [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.
  ☆111Updated last year