A unified audio-video variational autoencoder with cross-modal alignment for joint reconstruction and generation
☆100Nov 6, 2026Updated this week
Alternatives and similar repositories for OmniVAE
Users that are interested in OmniVAE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Audio-Oscar is a multi-agent framework for generating long-form, controllable audio from complex audio scene descriptions.☆69Jun 8, 2026Updated 4 months ago
- A curated list of models, datasets, and benchmarks for context-aware text-to-speech (TTS). This list covers conversational speech synthes…☆16Oct 27, 2026Updated last week
- Official code for "GROW: Group-Relative Advantage-Weighted On-Policy Reinforcement Learning of Autoregressive-Diffusion Text-to-Speech Mo…☆47Aug 11, 2026Updated 2 months ago
- [ACL 2026] DiTReducio: A Training-Free Acceleration for DiT-Based TTS viaProgressive Calibration☆14Apr 17, 2026Updated 6 months ago
- ☆26Oct 25, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A curated list of models, benchmarks, tools and guides for audio editing☆52Oct 30, 2026Updated last week
- Parameter-efficient text-to-audio generation for edge and low-memory deployment.☆20Updated this week
- ☆22May 25, 2026Updated 5 months ago
- Official code for "WavCube: Unifying Speech Representation for Understanding and Generation via Semantic-Acoustic Joint Modeling"☆64Jun 27, 2026Updated 4 months ago
- Unified Audio Scene Generation☆13Aug 21, 2026Updated 2 months ago
- [INTERSPEECH 2026] Pre-training, SFT, DPO and GRPO for Text-to-Audio Generation☆51Apr 17, 2026Updated 6 months ago
- Official repository for NVMOS: Non-Verbal Vocalization Quality Assessment in Speech☆26Jun 16, 2026Updated 4 months ago
- ☆41Jul 21, 2026Updated 3 months ago
- Official implementation of ACL'26 (findings) paper WESR (Word-level Event-Speech Recognition): A comprehensive benchmark and baseline for…☆48Jan 30, 2026Updated 9 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [ICASSP 2026] Official code for "Measuring Prosody Diversity in Zero-Shot TTS: A New Metric, Benchmark, and Exploration"☆18Apr 16, 2026Updated 6 months ago
- [INTERSPEECH 2026 Oral]Official code for "Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis"☆129Jun 21, 2026Updated 4 months ago
- Evaluating the Expressive Appropriateness of Speech in Rich Contexts☆18May 13, 2026Updated 5 months ago
- Build, run, and improve your own science research workflow, and evolve it.☆21Updated this week
- [ACL 2026 Main] Training, inference, and testing of the SAC speech codec model.☆114Nov 1, 2025Updated last year
- [EMNLP 2026' Main] HoliTok:A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding☆52Jun 8, 2026Updated 4 months ago
- Traceable TTS: Toward Watermark-Free TTS with Strong Traceability☆13Sep 4, 2025Updated last year
- A multi-user OpenClaw deployment with isolated workspaces and configurable model backends☆25Mar 30, 2026Updated 7 months ago
- ☆57Apr 26, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This is the official repository for the UltraVoice100K dataset, providing code and dataset samples.☆13Oct 26, 2025Updated last year
- An objective reconstruction evaluation toolkit for audio tokenizers, neural codecs, audio VAEs, and vocoders☆15Jun 16, 2026Updated 4 months ago
- end-to-end text to audio scene generation model☆53Jun 16, 2026Updated 4 months ago
- A benchmark for testing whether coding agents can resolve engineering tasks in scientific software☆87Oct 1, 2026Updated last month
- remote-terminal claw☆13Mar 27, 2026Updated 7 months ago
- Generate a complete audio clip with music, intelligible speech, and sound effects from text in one pass.☆46May 27, 2026Updated 5 months ago
- Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"☆41Jun 28, 2025Updated last year
- MMAE: A Massive Multitask Audio Editing Benchmark☆113Jun 8, 2026Updated 4 months ago
- ☆52Apr 27, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 5Hz Deep-Compression Speech VAE for AR-Diffusion and CALMs☆56Nov 19, 2025Updated 11 months ago
- ☆44Jun 3, 2026Updated 5 months ago
- [ACL 2026 Main] Open-Ended Speaking Style Modeling via Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-training☆109Apr 6, 2026Updated 7 months ago
- EMNLP 2026 | Official Repository of UltraVoice☆67Aug 30, 2026Updated 2 months ago
- Official implementation for paper "Fourier is Frontier: Frequency-Aware Autoencoding for High-Fidelity Music Reconstruction". We treat is…☆84Sep 1, 2026Updated 2 months ago
- This is the code for paper: XY-Tokenizer: Mitigating the Semantic-Acoustic Conflict in Low-Bitrate Speech Codecs☆98Sep 19, 2025Updated last year
- Qwen2.5-Omni fine-tuned on MNV-17 dataset for nonverbal vocalization recognition☆33Nov 13, 2025Updated 11 months ago