✨✨[NeurIPS 2025] VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model
☆699May 24, 2025Updated last year
Alternatives and similar repositories for VITA-Audio
Users that are interested in VITA-Audio are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆323May 14, 2025Updated last year
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆401May 27, 2025Updated last year
- ☆500May 6, 2025Updated last year
- ☆125May 18, 2026Updated 5 months ago
- ☆282May 19, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech☆374Aug 14, 2025Updated last year
- Align Anything: Training All-modality Model with Feedback☆4,667Nov 27, 2025Updated 10 months ago
- ☆31May 21, 2026Updated 4 months ago
- Sparrow: Data-Efficient Video-LLM with Text-to-Image Augmentation☆32Mar 28, 2025Updated last year
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆61Apr 14, 2025Updated last year
- ✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction☆2,538Mar 28, 2025Updated last year
- TVM Documentation in Chinese Simplified / TVM 中文文档☆3,953May 20, 2026Updated 4 months ago
- Your faithful, impartial partner for audio evaluation — know yourself, know your rivals. 真实评测，知己知彼。A unified benchmark framework for ASR/…☆326Sep 16, 2026Updated last month
- The official implement of VITA, VITA15, LongVITA, VITA-Audio, VITA-VLA, and VITA-E.☆165Oct 28, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- We Speech Toolkit, LLM based Speech Toolkit for Speech Understanding, Generation, and Interaction☆213Jul 17, 2026Updated 3 months ago
- [CVPR 2026] PromptEnhancer is a prompt-rewriting tool, refining prompts into clearer, structured versions for better image generation.☆3,785Aug 18, 2026Updated 2 months ago
- FlashCosyVoice: A lightweight vLLM implementation built from scratch for CosyVoice.☆253Feb 25, 2026Updated 7 months ago
- ☆482May 19, 2025Updated last year
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆57May 15, 2025Updated last year
- MiMo-Audio: Audio Language Models are Few-Shot Learners☆1,088Jun 17, 2026Updated 4 months ago
- Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice☆535Dec 22, 2025Updated 9 months ago
- A Survey of Spoken Dialogue Models (60 pages)☆317Nov 28, 2024Updated last year
- ☆103Jan 19, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2609.17488☆4,387Sep 18, 2026Updated last month
- Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。☆1,934Jan 16, 2025Updated last year
- Codebase for 'Scaling Rich Style-Prompted Text-to-Speech Datasets'☆166Mar 26, 2026Updated 6 months ago
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"☆96Sep 18, 2025Updated last year
- [ACM Multimedia 24]The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural languag…☆201Feb 28, 2026Updated 7 months ago
- Ming-UniAudio: Speech LLM for Joint Understanding, Generation and Editing with Unified Representation☆458Nov 27, 2025Updated 10 months ago
- Fulling is an AI-powered Full-stack Engineer Agent. Built with Next.js, Claude, shadcn/ui, and PostgreSQL. Use kubernetes as infra.☆2,445Aug 17, 2026Updated 2 months ago
- Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale☆5,813Jun 1, 2026Updated 4 months ago
- MTLA: Multi-head Temporal Latent Attention☆761Oct 6, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Res-SAM Framework for GPR Underground Hazard Detection☆1,622Jun 15, 2026Updated 4 months ago
- A Benchmark for Evaluating Turn-Taking and Overlap Handling in Full-Duplex Spoken Dialogue Models☆320May 20, 2026Updated 4 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆110May 20, 2025Updated last year
- open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming…☆3,583Nov 5, 2024Updated last year
- [EMNLP 2025 Findings] A complete cross-modal RAG system for end-to-end speech-to-speech large models, including ASR-based Retrieval and E…☆32Jul 11, 2025Updated last year
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆102Oct 8, 2025Updated last year
- Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications☆92Dec 20, 2024Updated last year