✨✨[NeurIPS 2025] VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model
☆686May 24, 2025Updated last year
Alternatives and similar repositories for VITA-Audio
Users that are interested in VITA-Audio are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆306May 14, 2025Updated last year
- ☆500May 6, 2025Updated last year
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆398May 27, 2025Updated last year
- ☆125May 18, 2026Updated 4 months ago
- ☆281May 19, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech☆374Aug 14, 2025Updated last year
- Align Anything: Training All-modality Model with Feedback☆4,671Nov 27, 2025Updated 10 months ago
- ☆30May 21, 2026Updated 4 months ago
- Sparrow: Data-Efficient Video-LLM with Text-to-Image Augmentation☆32Mar 28, 2025Updated last year
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆61Apr 14, 2025Updated last year
- ✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction☆2,536Mar 28, 2025Updated last year
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,951May 20, 2026Updated 4 months ago
- We Speech Toolkit, LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction☆212Jul 17, 2026Updated 2 months ago
- The official implement of VITA, VITA15, LongVITA, VITA-Audio, VITA-VLA, and VITA-E.☆165Oct 28, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Your faithful, impartial partner for audio evaluation — know yourself, know your rivals. 真实评测,知己知彼。A unified benchmark framework for ASR/…☆325Sep 16, 2026Updated last week
- FlashCosyVoice: A lightweight vLLM implementation built from scratch for CosyVoice.☆253Feb 25, 2026Updated 7 months ago
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,778Aug 18, 2026Updated last month
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆57May 15, 2025Updated last year
- ☆481May 19, 2025Updated last year
- Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice☆534Dec 22, 2025Updated 9 months ago
- MiMo-Audio: Audio Language Models are Few-Shot Learners☆1,083Jun 17, 2026Updated 3 months ago
- A Survey of Spoken Dialogue Models (60 pages)☆317Nov 28, 2024Updated last year
- ☆103Jan 19, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2609.17488☆4,308Sep 18, 2026Updated last week
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆166Mar 26, 2026Updated 6 months ago
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,933Jan 16, 2025Updated last year
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"☆95Sep 18, 2025Updated last year
- [ACM Multimedia 24]The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural languag…☆202Feb 28, 2026Updated 6 months ago
- A Benchmark for Evaluating Turn-Taking and Overlap Handling in Full-Duplex Spoken Dialogue Models☆301May 20, 2026Updated 4 months ago
- Fulling is an AI-powered Full-stack Engineer Agent. Built with Next.js, Claude, shadcn/ui, and PostgreSQL. Use kubernetes as infra.☆2,445Aug 17, 2026Updated last month
- MTLA: Multi-head Temporal Latent Attention☆761Oct 6, 2025Updated 11 months ago
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,812Jun 1, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆102Oct 8, 2025Updated 11 months ago
- Res-SAM Framework for GPR Underground Hazard Detection☆1,622Jun 15, 2026Updated 3 months ago
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆92Dec 20, 2024Updated last year
- [EMNLP 2025 Findings] A complete cross-modal RAG system for end-to-end speech-to-speech large models, including ASR-based Retrieval and E…☆32Jul 11, 2025Updated last year
- Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation☆457Nov 27, 2025Updated 10 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆110May 20, 2025Updated last year
- [ICLR 2025] SOTA discrete acoustic codec models with 40/75 tokens per second for audio language modeling☆1,322Mar 2, 2025Updated last year