Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
☆63Jun 26, 2025Updated last year
Alternatives and similar repositories for Kling-Foley
Users that are interested in Kling-Foley are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official UniVerse-1 code.☆129Oct 13, 2025Updated 10 months ago
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆77Jul 20, 2026Updated last month
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆147Apr 7, 2026Updated 4 months ago
- Audio-FLAN☆163Sep 23, 2025Updated 11 months ago
- [INTERSPEECH 2026 Oral]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆124Jun 21, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A streaming audio reader, processor, and writer built on top of soundfile, and PyAV (bindings for FFmpeg)☆39Aug 27, 2026Updated last week
- ☆35Sep 6, 2025Updated 11 months ago
- Pytorch Implementation of the paper "M3-TTS: Multi-modal DiT Alignment & Mel-latent for Zero-shot High-fidelity Speech Synthesis"☆124Dec 18, 2025Updated 8 months ago
- ☆23Oct 15, 2025Updated 10 months ago
- [ACL 2026 Main] Open-Ended Speaking Style Modeling via Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-training☆106Apr 6, 2026Updated 4 months ago
- semantic tokenizer for speech and music☆20Jul 6, 2025Updated last year
- A curated list of models, benchmarks, tools and guides for audio editing☆44Aug 26, 2026Updated last week
- [ICLR'25] Official repository for "AVHBench: A Cross-Modal Hallucination Evaluation for Audio-Visual Large Language Models"☆26Mar 8, 2026Updated 5 months ago
- Official implementation: "AudioSet-R: A Refined AudioSet with Multi-Stage LLM Label Reannotation"☆20Oct 9, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A single-layer, streaming codec model providing SOTA audio quality and discrete tokens designed for superior downstream modelability.☆127Jun 4, 2025Updated last year
- ☆56Apr 30, 2026Updated 4 months ago
- Official implementation of ACL'26 (findings) paper WESR (Word-level Event-Speech Recognition): A comprehensive benchmark and baseline for…☆48Jan 30, 2026Updated 7 months ago
- ☆50Apr 26, 2026Updated 4 months ago
- ☆112Jul 15, 2026Updated last month
- The demo page for ALMTokenizer☆59Apr 14, 2025Updated last year
- [NeurIPS 2025] PyTorch implementation of [ThinkSound], a unified framework for generating audio from any modality, guided by Chain-of-Tho…☆1,378Apr 3, 2026Updated 5 months ago
- The official implementation of "Sparse-vDiT: Unleashing the Power of Sparse Attention to Accelerate Video Diffusion Transformers" (arXiv …☆53Jun 6, 2025Updated last year
- ☆39Jul 21, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A TTS Trained on Universal Audio.☆42Jun 6, 2025Updated last year
- Official repo for SAO-Instruct: Free-form Audio Editing using Natural Language Instructions presented at NeurIPS 2025☆19Oct 28, 2025Updated 10 months ago
- Prediction of sound event bounding boxes (SEBBs)☆35Aug 2, 2024Updated 2 years ago
- Descript Audio Codec - VAE Variant (.dac-vae): High-Fidelity Audio Compression with Variational Autoencoder☆41Aug 30, 2025Updated last year
- Official implementation of MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglement (ICLR2026)☆299Mar 24, 2026Updated 5 months ago
- [INTERSPEECH 2026] Pre-training, SFT, DPO and GRPO for Text-to-Audio Generation☆50Apr 17, 2026Updated 4 months ago
- Video Background Music Generation Using Unpaired Audio-Visual Data☆35Oct 8, 2024Updated last year
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆221Feb 25, 2026Updated 6 months ago
- 5Hz Deep-Compression Speech VAE for AR-Diffusion and CALMs☆57Nov 19, 2025Updated 9 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆90Jan 4, 2026Updated 7 months ago
- Official code for "WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modeling"☆64Jun 27, 2026Updated 2 months ago
- [NAACL 2025] WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matching☆133Apr 8, 2026Updated 4 months ago
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆71Dec 26, 2025Updated 8 months ago
- ☆13Mar 23, 2026Updated 5 months ago
- ☆24May 25, 2026Updated 3 months ago
- T5Voice is a lightweight PyTorch implementation of T5-based text-to-speech synthesis, supporting both streaming and non-streaming speech …☆28Nov 7, 2025Updated 9 months ago