Foley-Omni: a unified multimodal audio generation model for task-level synthesis and complete video soundtrack generation, producing speech, sound effects, and music conditioned on text and video.
☆24Jun 5, 2026Updated last month
Alternatives and similar repositories for Foley-Omni
Users that are interested in Foley-Omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- M7-TTS: A Mini-Scale Multilingual and Multi-Dialect Text-to-Speech Language Model with Mimi codec and Multi Token Prediction☆20Mar 19, 2026Updated 4 months ago
- HoliTok:A Coutinuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding☆40Jun 8, 2026Updated last month
- Covo-Audio is a 7B-parameter end-to-end large audio language model that directly processes continuous audio inputs and generates audio ou…☆176Mar 17, 2026Updated 4 months ago
- [ACL 2026 Main] Training, inference, and testing of the SAC speech codec model.☆108Nov 1, 2025Updated 9 months ago
- FlowMirror-HydraVox — A natively accelerated multi-head autoregressive TTS system derived from CosyVoice 3.0. It predicts multiple tokens…☆49Feb 17, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆28Apr 6, 2026Updated 3 months ago
- [INTERSPEECH 2026] Pre-training, SFT, DPO and GRPO for Text-to-Audio Generation☆48Apr 17, 2026Updated 3 months ago
- Speaker-Reasoner: Scaling Interaction Turns and Reasoning Patterns for Timestamped Speaker-Attributed ASR☆94May 13, 2026Updated 2 months ago
- Official implementation of paper "Target Speaker Extraction through Comparing Noisy Positive and Negative Audio Enrollments"☆22Jul 21, 2026Updated 2 weeks ago
- Scaled diffusion transformer for text-to-speech synthesis (DiT + T5Gemma2 conditioning, TorchTitan & Megatron backends, tested up to 1024…☆24Mar 29, 2026Updated 4 months ago
- end-to-end text to audio scene generation model☆50Jun 16, 2026Updated last month
- ☆30May 21, 2026Updated 2 months ago
- A curated list of models, benchmarks, tools and guides for audio editing☆35Updated this week
- NVV-SuperBench: Beyond Words, Beyond Quality—Benchmarking Nonverbal Vocalizations in Speech Generation (Interspeech 2026 long paper)☆18Jun 21, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation☆453Nov 27, 2025Updated 8 months ago
- ☆48Apr 27, 2026Updated 3 months ago
- ☆22Jan 27, 2026Updated 6 months ago
- ☆42Nov 18, 2025Updated 8 months ago
- ☆28May 22, 2026Updated 2 months ago
- Towards Fine-Grained Multi-Dimensional Speech Understanding: Data Pipeline, Benchmark, and Model☆25May 21, 2026Updated 2 months ago
- ☆47Jul 5, 2026Updated 3 weeks ago
- [INTERSPEECH 2026 Oral]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆121Jun 21, 2026Updated last month
- Ming-omni-tts: Simple and Efficient Unified Generation of Speech, Music, and Sound with Precise Control☆265Feb 26, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- TASU: A New Style of Alignment of Speech LLM with only Text Training Data, zero-shot on ASR and Other SU tasks☆27Jul 20, 2026Updated 2 weeks ago
- ☆25Mar 12, 2022Updated 4 years ago
- The demo page for ALMTokenizer☆59Apr 14, 2025Updated last year
- ICLR 2026 (Oral) | EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning☆59Feb 12, 2026Updated 5 months ago
- Timbre Transfer using Denoising Diffusion Implicit Models (ISMIR 2023)☆28Mar 22, 2025Updated last year
- Linear Prediction Coefficients estimation from mel-spectrogram implemented in Python based on Levinson-Durbin algorithm.☆72Mar 19, 2021Updated 5 years ago
- Probabilistic Spherical Discriminant Analysis☆12Oct 29, 2022Updated 3 years ago
- Generate a complete audio clip with music, intelligible speech, and sound effects from text in one pass.☆44May 27, 2026Updated 2 months ago
- RepVgg + HiFiGAN☆36Aug 10, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Once more Diarization: Improving meeting transcription systems through segment-level speaker reassignment☆14Feb 5, 2025Updated last year
- Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.☆137Sep 25, 2023Updated 2 years ago
- ☆27Nov 3, 2025Updated 9 months ago
- Native full-duplex speech dialogue inference for BayLing-Duplex.☆64Jun 22, 2026Updated last month
- ☆29Jul 3, 2026Updated last month
- We Speech Toolkit, LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction☆206Jul 17, 2026Updated 2 weeks ago
- [CVPR 2025] Official implementation of paper "Prosody-Enhanced Acoustic Pre-training and Acoustic-Disentangled Prosody Adapting for Movie…☆23Jun 6, 2025Updated last year