Official repository for the paper Multimodal Transformer Distillation for Audio-Visual Synchronization (ICASSP 2024).
☆29Apr 3, 2024Updated 2 years ago
Alternatives and similar repositories for MTDVocaLiST
Users that are interested in MTDVocaLiST are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository for the paper VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices☆73Apr 7, 2024Updated 2 years ago
- Official Implementation and Dataset of paper - DFADD: The Diffusion and Flow-matching based Audio Deepfake Dataset☆17Apr 7, 2025Updated last year
- ☆14Mar 18, 2026Updated 7 months ago
- A survey of spoken dialogue models (SDMs) with speech input and speech output. Focus on their Intermediate Representation and Generation …☆32Mar 24, 2026Updated 7 months ago
- This repository contains the official code for LPIPS-AttnWav2Lip. The paper has been accepted by the journal Speech Communication.☆14Jan 30, 2026Updated 9 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Unsupervised spoken sentence embeddings☆14Dec 14, 2022Updated 3 years ago
- Official repository for the paper Singing Voice Graph Modeling for SingFake Detection (Interspeech 2024).☆24Sep 19, 2025Updated last year
- AudioCodec-Hub is a Python library for encoding and decoding audio data, supporting various neural audio codec models☆25Sep 26, 2023Updated 3 years ago
- awesome-audio-visual-robustness☆12Jan 27, 2024Updated 2 years ago
- EMO-SUPERB: a reproducible speech emotion recognition benchmark with leakage-free splits for 6 datasets and 15 speech SSL models (IEEE SL…☆52Jul 30, 2026Updated 3 months ago
- Model See Model Do: Speech-Driven Facial Animation with Style Control☆28May 6, 2025Updated last year
- [EMNLP 2024] ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers☆128Mar 20, 2025Updated last year
- ☆11Dec 15, 2025Updated 10 months ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Oct 11, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The open source code of ALMTokenizer2: Towards Low bit-rate and Semantic-rich Audio Tokenizer with Flow-based Scalar Diffusion Transforme…☆46Sep 5, 2025Updated last year
- Xemo-Talker: Unlock Emotions Explicitly for Audio-Driven Talking Portrait Synthesis☆18Aug 9, 2026Updated 2 months ago
- [Interspeech 2025] DualCodec: A Low-Frame-Rate, Semantically-Enhanced Neural Audio Codec☆72Sep 9, 2026Updated last month
- [ICME 2025] DiffusionTalker: Efficient and Compact Speech-Driven 3D Talking Head via Personalizer-Guided Distillation☆24Mar 25, 2025Updated last year
- ☆23Mar 31, 2022Updated 4 years ago
- LLM-Codec: Neural Audio Codec Meets Language Model Objectives☆23May 3, 2026Updated 6 months ago
- ☆19Jun 14, 2025Updated last year
- [ICASSP 2024] Max-AST: Combining Convolution, Local and Global Self-Attentions for Audio Event Classification☆13Mar 10, 2025Updated last year
- The official code for paper: GoHD: Gaze-oriented and Highly Disentangled Portrait Animation with Rhythmic Poses and Realistic Expressions…☆24May 28, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- PyTorch implementation of "StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generator"☆212Aug 8, 2023Updated 3 years ago
- ☆33Jun 30, 2025Updated last year
- ☆12Mar 26, 2025Updated last year
- The demo page for ALMTokenizer☆59Apr 14, 2025Updated last year
- This repository presents FSD dataset for song deepfake detection.☆24Aug 18, 2025Updated last year
- ☆39Jan 30, 2026Updated 9 months ago
- This repository contains the code for the paper "voc2vec: A Foundation Model for Non-Verbal Vocalization", accepted at ICASSP 2025.☆59Apr 14, 2025Updated last year
- A fully and partially fake speech dataset for evaluation☆15Nov 11, 2025Updated 11 months ago
- ☆187Jul 12, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- R2-Talker: Realistic Real-Time Talking Head Synthesis with Hash Grid Landmarks Encoding and Progressive Multilayer Conditioning☆82Jan 3, 2024Updated 2 years ago
- Source code for the EMNLP 2025 paper “DM-Codec: Distilling Multimodal Representations for Speech Tokenization”☆57Jun 1, 2025Updated last year
- ☆13Mar 28, 2024Updated 2 years ago
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆41Sep 14, 2023Updated 3 years ago
- Official repository for Mamba-based Segmentation Model for Speaker Diarization☆47May 13, 2025Updated last year
- LIA-X: Interpretable Latent Portrait Animator☆106Sep 17, 2025Updated last year
- A Transformer approach for polyphonic Audio-to-Score (A2S) transcription (ICASSP 2024)☆15Jun 21, 2025Updated last year