Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
☆62Jun 26, 2025Updated last year
Alternatives and similar repositories for Kling-Foley
Users that are interested in Kling-Foley are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official UniVerse-1 code.☆129Oct 13, 2025Updated 10 months ago
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆76Jul 20, 2026Updated 3 weeks ago
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆145Apr 7, 2026Updated 4 months ago
- Audio-FLAN☆161Sep 23, 2025Updated 10 months ago
- [INTERSPEECH 2026 Oral]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆122Jun 21, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A streaming audio reader, processor, and writer built on top of soundfile, and PyAV (bindings for FFmpeg)☆39Mar 31, 2026Updated 4 months ago
- ☆35Sep 6, 2025Updated 11 months ago
- Pytorch Implementation of the paper "M3-TTS: Multi-modal DiT Alignment & Mel-latent for Zero-shot High-fidelity Speech Synthesis"☆123Dec 18, 2025Updated 7 months ago
- ☆23Oct 15, 2025Updated 9 months ago
- [ACL 2026 Main] Open-Ended Speaking Style Modeling via Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-training☆104Apr 6, 2026Updated 4 months ago
- semantic tokenizer for speech and music☆20Jul 6, 2025Updated last year
- A curated list of models, benchmarks, tools and guides for audio editing☆35Aug 6, 2026Updated last week
- [ICLR'25] Official repository for "AVHBench: A Cross-Modal Hallucination Evaluation for Audio-Visual Large Language Models"☆26Mar 8, 2026Updated 5 months ago
- Official implementation: "AudioSet-R: A Refined AudioSet with Multi-Stage LLM Label Reannotation"☆20Oct 9, 2025Updated 10 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A single-layer, streaming codec model providing SOTA audio quality and discrete tokens designed for superior downstream modelability.☆126Jun 4, 2025Updated last year
- ☆53Apr 30, 2026Updated 3 months ago
- Official implementation of ACL'26 (findings) paper WESR (Word-level Event-Speech Recognition): A comprehensive benchmark and baseline for…☆47Jan 30, 2026Updated 6 months ago
- ☆45Apr 26, 2026Updated 3 months ago
- ☆110Jul 15, 2026Updated 3 weeks ago
- The demo page for ALMTokenizer☆59Apr 14, 2025Updated last year
- [NeurIPS 2025] PyTorch implementation of [ThinkSound], a unified framework for generating audio from any modality, guided by Chain-of-Tho…☆1,375Apr 3, 2026Updated 4 months ago
- The official implementation of "Sparse-vDiT: Unleashing the Power of Sparse Attention to Accelerate Video Diffusion Transformers" (arXiv …☆53Jun 6, 2025Updated last year
- ☆35Jul 21, 2026Updated 3 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A TTS Trained on Universal Audio.☆41Jun 6, 2025Updated last year
- Official repo for SAO-Instruct: Free-form Audio Editing using Natural Language Instructions presented at NeurIPS 2025☆18Oct 28, 2025Updated 9 months ago
- Prediction of sound event bounding boxes (SEBBs)☆35Aug 2, 2024Updated 2 years ago
- Descript Audio Codec - VAE Variant (.dac-vae): High-Fidelity Audio Compression with Variational Autoencoder☆39Aug 30, 2025Updated 11 months ago
- Official implementation of MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglement (ICLR2026)☆300Mar 24, 2026Updated 4 months ago
- [INTERSPEECH 2026] Pre-training, SFT, DPO and GRPO for Text-to-Audio Generation☆49Apr 17, 2026Updated 3 months ago
- Video Background Music Generation Using Unpaired Audio-Visual Data☆35Oct 8, 2024Updated last year
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆216Feb 25, 2026Updated 5 months ago
- 5Hz Deep-Compression Speech VAE for AR-Diffusion and CALMs☆57Nov 19, 2025Updated 8 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆88Jan 4, 2026Updated 7 months ago
- Official code for "WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modeling"☆63Jun 27, 2026Updated last month
- [NAACL 2025] WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matching☆133Apr 8, 2026Updated 4 months ago
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆68Dec 26, 2025Updated 7 months ago
- ☆13Mar 23, 2026Updated 4 months ago
- ☆23May 25, 2026Updated 2 months ago
- T5Voice is a lightweight PyTorch implementation of T5-based text-to-speech synthesis, supporting both streaming and non-streaming speech …☆28Nov 7, 2025Updated 9 months ago