Alternatives and similar repositories for MPDD

Users that are interested in MPDD are comparing it to the libraries listed below

• spkgyk / TDFNet
  Official code release for "TDFNet: An Efficient Audio-Visual Speech Separation Model with Top-down Fusion", accepted ICIST 2023
  ☆12Updated last year
• GalaxyCong / HPMDubbing
  [CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.
  ☆109Updated last year
• scutcsq / DWFormer
  DWFormer: Dynamic Window Transformer for Speech Emotion Recognition(ICASSP 2023 Oral)
  ☆64Updated last year
• AI-S2-Lab / MEIJU2025-baseline
  ☆22Updated 11 months ago
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆41Updated last year
• HappyColor / SpeechFormer2
  SpeechFormer++ in PyTorch
  ☆48Updated 2 years ago
• usc-sail / trust-ser
  Trustworthy Speech Emotion Recognition
  ☆13Updated 2 years ago
• sunlicai / HiCMAE
  [Information Fusion 2024] HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion Recognition
  ☆114Updated last month
• zeroQiaoba / MERTools
  Toolkits for Multimodal Emotion Recognition
  ☆253Updated 5 months ago
• john852517791 / pytorch_lightning_FAD
  This is a general framework for fake audio detection using pytorch lightning
  ☆24Updated 2 months ago
• thuhcsi / SECap
  ☆172Updated last year
• Lum1104 / MER-Factory
  🚀 Pre-process, annotate, evaluate, and train your Affect Computing (e.g., Multimodal Emotion Recognition, Sentiment Analysis) datasets A…
  ☆52Updated last week
• ASolitaryMan / HFLEA
  FRAME-LEVEL EMOTIONAL STATE ALIGNMENT METHOD FOR SPEECH EMOTION RECOGNITION
  ☆23Updated 9 months ago
• ECNU-Cross-Innovation-Lab / ENT
  [ICASSP 2024] Emotion Neural Transducer for Fine-Grained Speech Emotion Recognition
  ☆25Updated last year
• katerynaCh / MMA-DFER
  This repository provides the codes for MMA-DFER: multimodal (audiovisual) emotion recognition method. This is an official implementation …
  ☆47Updated last year
• Levent9 / Zero-shot-FaceVC
  ☆19Updated last year
• samsad35 / VQ-MAE-S-code
  [ICASSPW] A Vector Quantized Masked AutoEncoder for speech emotion recognition
  ☆28Updated last year
• Sreyan88 / MMER
  Code for the InterSpeech 2023 paper: MMER: Multimodal Multi-task learning for Speech Emotion Recognition
  ☆75Updated last year
• ECNU-Cross-Innovation-Lab / ShiftSER
  [ICASSP 2023] Mingling or Misalignment? Temporal Shift for Speech Emotion Recognition with Pre-trained Representations
  ☆39Updated last year
• GalaxyCong / StyleDubber
  [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"
  ☆91Updated 11 months ago
• Ming-er / MGA-CLAP
  official implementation of MGA-CLAP (ACM MM 2024)
  ☆21Updated 11 months ago
• NUSTM / UniVA
  A Unimodal Valence-Arousal Driven Contrastive Learning Framework for Multimodal Multi-Label Emotion Recognition (ACM MM 2024 oral)
  ☆25Updated 11 months ago
• Vincent-ZHQ / CA-MSER
  Code for Speech Emotion Recognition with Co-Attention based Multi-level Acoustic Information
  ☆155Updated last year
• DanielMengLiu / AudioVisualLip
  ☆23Updated last year
• ZZDoog / Speaker2Dubber
  [ACM MM24] Official implementation of paper "From Speaker to Dubber: Movie Dubbing with Prosody and Duration Consistency Learning"
  ☆29Updated 5 months ago
• the-anonymous-bs / av-SALMONN
  av-SALMONN: Speech-Enhanced Audio-Visual Large Language Models
  ☆13Updated last year
• burchim / AVEC
  [WACV 2023] Audio-Visual Efficient Conformer (AVEC) for Robust Speech Recognition
  ☆99Updated 2 years ago
• Exgc / OpenSR
  The official implementation of OpenSR (ACL2023 Oral)
  ☆15Updated last year
• EMOsuperb / EMO-SUPERB-submission
  EMO-SUPERB submission
  ☆47Updated this week
• HappyColor / DST
  Deformable Speech Transformer (DST)
  ☆34Updated last year