Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
☆62Jun 26, 2025Updated 11 months ago
Alternatives and similar repositories for Kling-Foley
Users that are interested in Kling-Foley are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official UniVerse-1 code.☆129Oct 13, 2025Updated 8 months ago
- Curated list for papers, codes and resources related to Text-to-Audio (TTA) Generation☆73May 27, 2026Updated 2 weeks ago
- [ICLR'25] Official repository for "AVHBench: A Cross-Modal Hallucination Evaluation for Audio-Visual Large Language Models"☆25Mar 8, 2026Updated 3 months ago
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆18Apr 2, 2025Updated last year
- Pytorch Implementation of the paper "M3-TTS: Multi-modal DiT Alignment & Mel-latent for Zero-shot High-fidelity Speech Synthesis"☆123Dec 18, 2025Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Open Source code for our paper, Steering Autoregressive Music Generation with Recursive Feature Machines (Zhao et al., 2025). aka MusicRF…☆40Oct 26, 2025Updated 7 months ago
- This is the official implementation for the paper "Pianist Transformer: Towards Expressive Piano Performance Rendering via Scalable Self-…☆36Mar 30, 2026Updated 2 months ago
- Audio-FLAN☆161Sep 23, 2025Updated 8 months ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)☆34Feb 11, 2026Updated 4 months ago
- ☆25Sep 5, 2025Updated 9 months ago
- [INTERSPEECH 2026]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆112Jun 3, 2026Updated last week
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆136Apr 7, 2026Updated 2 months ago
- Compute WER and SER for speech recognition evaluation☆26Jun 6, 2026Updated last week
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆23Apr 10, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Video Background Music Generation Using Unpaired Audio-Visual Data☆31Oct 8, 2024Updated last year
- A streaming audio reader, processor, and writer built on top of soundfile, and PyAV (bindings for FFmpeg)☆39Mar 31, 2026Updated 2 months ago
- [ICLR 2026] An official implementation of "STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence"☆42Apr 19, 2026Updated last month
- Open SingSong - Implementation of 'SingSong: Generating Musical Accompaniments from Singing' by Google Research, with a few modifications☆16Jun 10, 2024Updated 2 years ago
- [ACL 2026 Main] MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flows☆140Sep 2, 2025Updated 9 months ago
- ☆20Aug 11, 2025Updated 10 months ago
- ☆45Jun 25, 2025Updated 11 months ago
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".☆93Dec 8, 2023Updated 2 years ago
- ☆17Jan 22, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ViSAudio: End-to-End Video-Driven Binaural Spatial Audio Generation☆118Dec 11, 2025Updated 6 months ago
- ASID-Caption: Attribute-Structured and Quality-Verified Audiovisual Instruction Dataset and Training Pipeline for Fine-Grained Video Unde…☆65Mar 3, 2026Updated 3 months ago
- [ASRU 2025] Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?☆47Nov 21, 2025Updated 6 months ago
- Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".☆347Aug 4, 2025Updated 10 months ago
- [CVPR2025] Extrapolating and Decoupling Image-to-Video Generation Models: Motion Modeling is Easier Than You Think☆24Jul 1, 2025Updated 11 months ago
- [ICLR 2026] Official implementation of JavisDiT and JavisDiT++ series.☆370Mar 29, 2026Updated 2 months ago
- ☆50Aug 27, 2024Updated last year
- ☆132Feb 6, 2025Updated last year
- ☆36Sep 6, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [NeurIPS 2025] PyTorch implementation of [ThinkSound], a unified framework for generating audio from any modality, guided by Chain-of-Tho…☆1,366Apr 3, 2026Updated 2 months ago
- A modern TypeScript-based rewrite of blueprint3d — faster, cleaner, and actively maintained.☆101May 22, 2026Updated 3 weeks ago
- Make-An-Audio-3: Transforming Text/Video into Audio via Flow-based Large Diffusion Transformers☆121May 19, 2025Updated last year
- Stress-Testing Image Generation Models with Explainable Human Evaluation on Open-ended Real-World Tasks [ICLR 2026]☆33Apr 2, 2026Updated 2 months ago
- ☆71Dec 30, 2025Updated 5 months ago
- ☆44Jan 13, 2025Updated last year
- The official repository for the paper “NonVerbalSpeech-38K: A Scalable Pipeline for Enabling Non-Verbal Speech Generation and Understandi…☆66Dec 26, 2025Updated 5 months ago