Foley-Omni: a unified multimodal audio generation model for task-level synthesis and complete video soundtrack generation, producing speech, sound effects, and music conditioned on text and video.
☆27Jun 5, 2026Updated 4 months ago
Alternatives and similar repositories for Foley-Omni
Users that are interested in Foley-Omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- M7-TTS: A Mini-Scale Multilingual and Multi-Dialect Text-to-Speech Language Model with Mimi codec and Multi Token Prediction☆20Mar 19, 2026Updated 6 months ago
- [EMNLP 2026' Main] HoliTok:A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding☆51Jun 8, 2026Updated 3 months ago
- Covo-Audio is a 7B-parameter end-to-end large audio language model that directly processes continuous audio inputs and generates audio ou…☆184Mar 17, 2026Updated 6 months ago
- [ACL 2026 Main] Training, inference, and testing of the SAC speech codec model.☆111Nov 1, 2025Updated 11 months ago
- FlowMirror-HydraVox — A natively accelerated multi-head autoregressive TTS system derived from CosyVoice 3.0. It predicts multiple tokens…☆49Feb 17, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆29Apr 6, 2026Updated 5 months ago
- [INTERSPEECH 2026] Pre-training, SFT, DPO and GRPO for Text-to-Audio Generation☆51Apr 17, 2026Updated 5 months ago
- Speaker-Reasoner: Scaling Interaction Turns and Reasoning Patterns for Timestamped Speaker-Attributed ASR☆96May 13, 2026Updated 4 months ago
- Official implementation of paper "Target Speaker Extraction through Comparing Noisy Positive and Negative Audio Enrollments"☆26Jul 21, 2026Updated 2 months ago
- Scaled diffusion transformer for text-to-speech synthesis (DiT + T5Gemma2 conditioning, TorchTitan & Megatron backends, tested up to 1024…☆25Mar 29, 2026Updated 6 months ago
- end-to-end text to audio scene generation model☆53Jun 16, 2026Updated 3 months ago
- ☆31May 21, 2026Updated 4 months ago
- A curated list of models, benchmarks, tools and guides for audio editing☆49Updated this week
- NVV-SuperBench: Beyond Words, Beyond Quality—Benchmarking Nonverbal Vocalizations in Speech Generation (Interspeech 2026 long paper)☆19Jun 21, 2026Updated 3 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation☆458Nov 27, 2025Updated 10 months ago
- ☆52Apr 27, 2026Updated 5 months ago
- ☆43Nov 18, 2025Updated 10 months ago
- ☆29May 22, 2026Updated 4 months ago
- ☆27Jan 27, 2026Updated 8 months ago
- ☆60Jul 5, 2026Updated 3 months ago
- Ming-omni-tts: Simple and Efficient Unified Generation of Speech, Music, and Sound with Precise Control☆265Feb 26, 2026Updated 7 months ago
- [INTERSPEECH 2026 Oral]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆130Jun 21, 2026Updated 3 months ago
- Towards Fine-Grained Multi-Dimensional Speech Understanding: Data Pipeline, Benchmark, and Model☆29May 21, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- TASU: A New Style of Alignment of Speech LLM with only Text Training Data, zero-shot on ASR and Other SU tasks☆28Jul 20, 2026Updated 2 months ago
- ☆25Mar 12, 2022Updated 4 years ago
- The demo page for ALMTokenizer☆59Apr 14, 2025Updated last year
- ICLR 2026 (Oral) | EmotionThinker: Prosody-Aware Reinforcement Learning for Explainable Speech Emotion Reasoning☆60Aug 7, 2026Updated last month
- Timbre Transfer using Denoising Diffusion Implicit Models (ISMIR 2023)☆28Mar 22, 2025Updated last year
- Linear Prediction Coefficients estimation from mel-spectrogram implemented in Python based on Levinson-Durbin algorithm.☆72Mar 19, 2021Updated 5 years ago
- Probabilistic Spherical Discriminant Analysis☆13Oct 29, 2022Updated 3 years ago
- Generate a complete audio clip with music, intelligible speech, and sound effects from text in one pass.☆46May 27, 2026Updated 4 months ago
- RepVgg + HiFiGAN☆36Aug 10, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Once more Diarization: Improving meeting transcription systems through segment-level speaker reassignment☆14Feb 5, 2025Updated last year
- Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.☆138Sep 25, 2023Updated 3 years ago
- ☆26Nov 3, 2025Updated 11 months ago
- Native full-duplex speech dialogue inference for BayLing-Duplex.☆93Jun 22, 2026Updated 3 months ago
- ☆30Jul 3, 2026Updated 3 months ago
- We Speech Toolkit, LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction☆212Jul 17, 2026Updated 2 months ago
- ☆44Jun 3, 2026Updated 4 months ago