Foley-Omni: a unified multimodal audio generation model for task-level synthesis and complete video soundtrack generation, producing speech, sound effects, and music conditioned on text and video.
☆24Jun 5, 2026Updated last month
Alternatives and similar repositories for Foley-Omni
Users that are interested in Foley-Omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FlowMirror-HydraVox — A natively accelerated multi-head autoregressive TTS system derived from CosyVoice 3.0. It predicts multiple tokens…☆49Feb 17, 2026Updated 4 months ago
- HoliTok:A Coutinuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding☆36Jun 8, 2026Updated last month
- Covo-Audio is a 7B-parameter end-to-end large audio language model that directly processes continuous audio inputs and generates audio ou…☆173Mar 17, 2026Updated 3 months ago
- ☆38Jul 5, 2026Updated last week
- Ming-omni-tts: Simple and Efficient Unified Generation of Speech, Music, and Sound with Precise Control☆260Feb 26, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The demo page for ALMTokenizer☆59Apr 14, 2025Updated last year
- [ACL 2026 Main] Training, inference, and testing of the SAC speech codec model.☆106Nov 1, 2025Updated 8 months ago
- Speaker-Reasoner: Scaling Interaction Turns and Reasoning Patterns for Timestamped Speaker-Attributed ASR☆89May 13, 2026Updated 2 months ago
- A curated list of models, benchmarks, tools and guides for audio editing☆31Jul 7, 2026Updated last week
- Scaled diffusion transformer for text-to-speech synthesis (DiT + T5Gemma2 conditioning, TorchTitan & Megatron backends, tested up to 1024…☆24Mar 29, 2026Updated 3 months ago
- end-to-end text to audio scene generation model☆49Jun 16, 2026Updated 3 weeks ago
- [Interspeech 2025] DualCodec: A Low-Frame-Rate, Semantically-Enhanced Neural Audio Codec☆71Mar 11, 2026Updated 4 months ago
- ☆30May 21, 2026Updated last month
- Inference for the STFT-VAE continuous audio codec (24kHz, 3.125Hz latent)☆42Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆51Jun 25, 2025Updated last year
- ☆47Apr 27, 2026Updated 2 months ago
- Towards Fine-Grained Multi-Dimensional Speech Understanding: Data Pipeline, Benchmark, and Model☆25May 21, 2026Updated last month
- [ACL 2026 Main] Open-Ended Speaking Style Modeling via Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-training☆104Apr 6, 2026Updated 3 months ago
- ☆28May 22, 2026Updated last month
- [INTERSPEECH 2025 Oral]Official code for "Accelerating Diffusion-based Text-to-Speech Model Training with Dual Modality Alignment"☆67Jun 16, 2025Updated last year
- An Open-Source Project to Unify Audio Processing and Generation☆452Jul 7, 2026Updated last week
- Timbre Transfer using Denoising Diffusion Implicit Models (ISMIR 2023)☆28Mar 22, 2025Updated last year
- ☆25Mar 12, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Linear Prediction Coefficients estimation from mel-spectrogram implemented in Python based on Levinson-Durbin algorithm.☆72Mar 19, 2021Updated 5 years ago
- ACL 2026 - Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Control☆119Apr 11, 2026Updated 3 months ago
- A warm, minimal, responsive academic homepage template.☆62Apr 10, 2026Updated 3 months ago
- OmniCodec: Low Frame Rate Universal Audio Codec with Semantic–Acoustic Disentanglement☆45Apr 17, 2026Updated 2 months ago
- ☆42Jun 3, 2026Updated last month
- Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.☆135Sep 25, 2023Updated 2 years ago
- ☆43Apr 26, 2026Updated 2 months ago
- Probabilistic Spherical Discriminant Analysis☆12Oct 29, 2022Updated 3 years ago
- Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillation☆52Jun 16, 2026Updated 3 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Native full-duplex speech dialogue inference for BayLing-Duplex.☆56Jun 22, 2026Updated 3 weeks ago
- ☆27Jul 3, 2026Updated last week
- RepVgg + HiFiGAN☆36Aug 10, 2022Updated 3 years ago
- Once more Diarization: Improving meeting transcription systems through segment-level speaker reassignment☆14Feb 5, 2025Updated last year
- ControlFoley: Unified and Controllable Video-to-Audio Generation with Cross-Modal Conflict Handling☆142Updated this week
- [CVPR 2025] Official implementation of paper "Prosody-Enhanced Acoustic Pre-training and Acoustic-Disentangled Prosody Adapting for Movie…☆23Jun 6, 2025Updated last year
- MOSS-Audio is an open-source foundation model for unified audio understanding, enabling speech, sound, music, captioning, QA, and reasoni…☆601Jun 2, 2026Updated last month