A unified audio-video variational autoencoder with cross-modal alignment for joint reconstruction and generation
☆91Oct 17, 2026Updated this week
Alternatives and similar repositories for OmniVAE
Users that are interested in OmniVAE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MMAE: A Massive Multitask Audio Editing Benchmark☆112Jun 8, 2026Updated 4 months ago
- Official Repo for "AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approach"☆61Updated this week
- Synthesizing, Benchmarking, and Training for Native Audio-Visual Dialogue☆216Sep 21, 2026Updated 3 weeks ago
- Samsone: A Family of Open Small Audio Language Models for On-Device Inference☆45Sep 28, 2026Updated 2 weeks ago
- [ICASSP 2026]Official code for "Prosody-Guided Harmonic Attention for Phase-Coherent Neural Vocoding in the Complex Spectrum"☆27Jan 22, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Memory-efficient CTC loss with exact loss and first-order gradient equivalence under vocabulary reduction, and activation memory that no …☆121Sep 30, 2026Updated 2 weeks ago
- ☆40Jul 21, 2026Updated 2 months ago
- [INTERSPEECH 2026] Pre-training, SFT, DPO and GRPO for Text-to-Audio Generation☆51Apr 17, 2026Updated 6 months ago
- [ICASSP 2026] Task Vector in TTS: Toward Emotionally Expressive Dialectal Speech Synthesis☆43Dec 24, 2025Updated 9 months ago
- Official code for "WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modeling"☆64Jun 27, 2026Updated 3 months ago
- A curated list of models, benchmarks, tools and guides for audio editing☆52Updated this week
- [ICASSP 2026] Official code for "Measuring Prosody Diversity in Zero-Shot TTS: A New Metric, Benchmark, and Exploration"☆18Apr 16, 2026Updated 6 months ago
- ☆76Jul 29, 2026Updated 2 months ago
- LLM‑driven autoregressive flow matching for unified speech‑music‑sound‑effect audio scene generation☆99Aug 13, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆51Apr 26, 2026Updated 5 months ago
- [ACL 2026 Main] FineLAP: Taming Heterogeneous Supervision for Fine-grained Language-Audio Pre-training☆40Apr 20, 2026Updated 5 months ago
- [INTERSPEECH 2026 Oral]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆130Jun 21, 2026Updated 3 months ago
- Official repo for DisCodec presented at Audio Imagination Workshop @NeurIPS 2024☆14Dec 18, 2024Updated last year
- Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillation☆76Jun 16, 2026Updated 4 months ago
- Scaled diffusion transformer for text-to-speech synthesis (DiT + T5Gemma2 conditioning, TorchTitan & Megatron backends, tested up to 1024…☆25Mar 29, 2026Updated 6 months ago
- ☆10Jun 11, 2024Updated 2 years ago
- Generate accompaniment part with chords using Evolutionary algorithm.☆11May 8, 2022Updated 4 years ago
- EMNLP 2026 | Official Repository of UltraVoice☆67Aug 30, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- end-to-end text to audio scene generation model☆53Jun 16, 2026Updated 4 months ago
- [ACL 2025] OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching☆45Feb 9, 2025Updated last year
- ☆35Oct 23, 2025Updated 11 months ago
- An All-in-One Speech, Sound, Music Codec with Single Nested Codebook☆28Oct 11, 2025Updated last year
- Official repository for the paper "Audio ControlNet for Fine-Grained Audio Generation and Editing".☆82Feb 7, 2026Updated 8 months ago
- ☆177Updated this week
- ESLTTS dataset☆16Feb 6, 2025Updated last year
- RWKV-SpeechChat is a real-time dialogue script based on a frozen 3B RWKV model with trained adapters and initial states. Various trained …☆29Jan 1, 2025Updated last year
- ☆67Aug 26, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A Robust Low-Latency Streaming Zero-Shot Voice Conversion☆171Sep 13, 2026Updated last month
- ☆21Nov 22, 2025Updated 10 months ago
- My hybrid TTS network that combines, VALL-E, VoiceBox, SpeechFlow, Seamless and TortoiseTTS into one☆26Aug 5, 2024Updated 2 years ago
- Streaming Vocos☆33Jun 10, 2025Updated last year
- ☆36Oct 9, 2026Updated last week
- Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models☆57Sep 2, 2025Updated last year
- Adaptive Multimodal Reasoning via Reinforcement Learning☆24Jan 11, 2026Updated 9 months ago