Foley-Omni: a unified multimodal audio generation model for task-level synthesis and complete video soundtrack generation, producing speech, sound effects, and music conditioned on text and video.
☆27Jun 5, 2026Updated 3 months ago
Alternatives and similar repositories for Foley-Omni
Users that are interested in Foley-Omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- M7-TTS: A Mini-Scale Multilingual and Multi-Dialect Text-to-Speech Language Model with Mimi codec and Multi Token Prediction☆20Mar 19, 2026Updated 5 months ago
- [EMNLP 2026' Main] HoliTok:A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding☆51Jun 8, 2026Updated 3 months ago
- Covo-Audio is a 7B-parameter end-to-end large audio language model that directly processes continuous audio inputs and generates audio ou…☆183Mar 17, 2026Updated 5 months ago
- [ACL 2026 Main] Training, inference, and testing of the SAC speech codec model.☆111Nov 1, 2025Updated 10 months ago
- FlowMirror-HydraVox — A natively accelerated multi-head autoregressive TTS system derived from CosyVoice 3.0. It predicts multiple tokens…☆49Feb 17, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆29Apr 6, 2026Updated 5 months ago
- [INTERSPEECH 2026] Pre-training, SFT, DPO and GRPO for Text-to-Audio Generation☆50Apr 17, 2026Updated 4 months ago
- Speaker-Reasoner: Scaling Interaction Turns and Reasoning Patterns for Timestamped Speaker-Attributed ASR☆94May 13, 2026Updated 4 months ago
- Official implementation of paper "Target Speaker Extraction through Comparing Noisy Positive and Negative Audio Enrollments"☆25Jul 21, 2026Updated last month
- Scaled diffusion transformer for text-to-speech synthesis (DiT + T5Gemma2 conditioning, TorchTitan & Megatron backends, tested up to 1024…☆25Mar 29, 2026Updated 5 months ago
- end-to-end text to audio scene generation model☆51Jun 16, 2026Updated 2 months ago
- ☆30May 21, 2026Updated 3 months ago
- A curated list of models, benchmarks, tools and guides for audio editing☆46Updated this week
- NVV-SuperBench: Beyond Words, Beyond Quality—Benchmarking Nonverbal Vocalizations in Speech Generation (Interspeech 2026 long paper)☆19Jun 21, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation☆456Nov 27, 2025Updated 9 months ago
- ☆51Apr 27, 2026Updated 4 months ago
- ☆43Nov 18, 2025Updated 9 months ago
- ☆29May 22, 2026Updated 3 months ago
- ☆27Jan 27, 2026Updated 7 months ago
- ☆59Jul 5, 2026Updated 2 months ago
- Ming-omni-tts: Simple and Efficient Unified Generation of Speech, Music, and Sound with Precise Control☆265Feb 26, 2026Updated 6 months ago
- [INTERSPEECH 2026 Oral]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆125Jun 21, 2026Updated 2 months ago
- Towards Fine-Grained Multi-Dimensional Speech Understanding: Data Pipeline, Benchmark, and Model☆27May 21, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- TASU: A New Style of Alignment of Speech LLM with only Text Training Data, zero-shot on ASR and Other SU tasks☆28Jul 20, 2026Updated last month
- ☆25Mar 12, 2022Updated 4 years ago
- The demo page for ALMTokenizer☆59Apr 14, 2025Updated last year
- ICLR 2026 (Oral) | EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning☆60Aug 7, 2026Updated last month
- Timbre Transfer using Denoising Diffusion Implicit Models (ISMIR 2023)☆28Mar 22, 2025Updated last year
- Linear Prediction Coefficients estimation from mel-spectrogram implemented in Python based on Levinson-Durbin algorithm.☆72Mar 19, 2021Updated 5 years ago
- Probabilistic Spherical Discriminant Analysis☆13Oct 29, 2022Updated 3 years ago
- Generate a complete audio clip with music, intelligible speech, and sound effects from text in one pass.☆46May 27, 2026Updated 3 months ago
- RepVgg + HiFiGAN☆36Aug 10, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Once more Diarization: Improving meeting transcription systems through segment-level speaker reassignment☆14Feb 5, 2025Updated last year
- Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.☆137Sep 25, 2023Updated 2 years ago
- ☆26Nov 3, 2025Updated 10 months ago
- Native full-duplex speech dialogue inference for BayLing-Duplex.☆89Jun 22, 2026Updated 2 months ago
- ☆30Jul 3, 2026Updated 2 months ago
- We Speech Toolkit, LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction☆212Jul 17, 2026Updated last month
- ☆44Jun 3, 2026Updated 3 months ago