The official implement of VITA, VITA15, LongVITA, VITA-Audio, VITA-VLA, and VITA-E.
☆166Oct 28, 2025Updated last year
Alternatives and similar repositories for VITA
Users that are interested in VITA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆31May 21, 2026Updated 5 months ago
- A novel benchmerk specially designed to evaluate Omni-LLMs under assistant-style, real-time video chat scenarios.☆34Aug 24, 2026Updated 2 months ago
- VideoDetective: Clue Hunting via both Extrinsic Query and Intrinsic Relevance for Long Video Understanding☆58May 1, 2026Updated 6 months ago
- ✨✨[ICML 2026] Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion☆156Mar 12, 2026Updated 7 months ago
- [IEEE TMM] Light-Omni: Reflex over Reasoning in Agentic Video Understanding with Long-Term Memory☆46Oct 17, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- OmniVideo-100K: A Dataset for Audio-Visual Reasoning through Structured Scripts and Evidence Chains☆69Jul 8, 2026Updated 3 months ago
- EvoEmbedding: Evolvable Representations for Long-Context Retrieval and Agentic Memory☆58Jul 24, 2026Updated 3 months ago
- [CVPR 2026 Highlight] PersonaVLM: Long-Term Personalized Multimodal LLMs☆128Apr 16, 2026Updated 6 months ago
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆338May 14, 2025Updated last year
- Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understanding☆368Aug 5, 2026Updated 2 months ago
- ✨✨ [ICLR 2026] MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models☆43Apr 10, 2025Updated last year
- ✨✨[NeurIPS 2025] VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model☆721May 24, 2025Updated last year
- The official implement of "Accelerating Multimodal Large Language Models via Dynamic Visual-Token Exit and the Empirical Findings"☆18Dec 5, 2024Updated last year
- ✨✨[AAAI 2026] This is the official implementation of our paper "QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Vi…☆80Apr 28, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction☆2,539Mar 28, 2025Updated last year
- Code for HEAR. Website: https://hear.irmv.top☆15Jul 27, 2026Updated 3 months ago
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆61Apr 14, 2025Updated last year
- ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆803Dec 8, 2025Updated 10 months ago
- The Next Step Forward in Multimodal LLM Alignment☆198May 1, 2025Updated last year
- ☆38Jul 9, 2024Updated 2 years ago
- [AAAI 2026] Official code for MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Man…☆70Jul 31, 2025Updated last year
- Dysl-vla：Official code for "DySL-VLA: Efficient Vision-Language-Action Model Inference via Dynamic-Static Layer-Skipping for Robot Manipu…☆26Jul 9, 2026Updated 3 months ago
- Retargeting EX12(Exoskeleton Glove) to GX11(Dexterous Hand)☆10Dec 9, 2025Updated 10 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ✨✨ [ICLR 2026] Think Beyond Images☆585Sep 23, 2025Updated last year
- A proactive robot manipulation model for multimodal physical environments☆124Mar 28, 2026Updated 7 months ago
- Official implementation of "Omni-Woodpecker: Hallucination Correction via Evidence-Prior Rebalancing for Omni LLMs"☆113Updated this week
- [TASLP] Open-Vocabulary Sound Event Localization and Detection with Joint Learning of CLAP Embedding and Activity-Coupled Cartesian DOA V…☆14Mar 25, 2026Updated 7 months ago
- [CVPR2025] The repository of SAM2-LOVE paper☆12Jun 6, 2025Updated last year
- ☆32Jul 29, 2024Updated 2 years ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆403May 27, 2025Updated last year
- HAMLET + Isaac GR00T (N1.6/N1.5)☆41Jun 22, 2026Updated 4 months ago
- OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants☆24May 30, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ✨✨ [ICLR 2026] R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆294May 9, 2025Updated last year
- [ICLR 2026] RIVER: A Real-Time Interaction Benchmark for Video LLMs☆19Apr 20, 2026Updated 6 months ago
- ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models☆649Dec 23, 2024Updated last year
- VLA^2: Empowering Vision-Language-Action Models with an Agentic Framework for Unseen Concept Manipulation☆36Nov 3, 2025Updated last year
- Python library to control GX11(Dexterous Hand) and EX12(Exoskeleton Glove)☆17Aug 30, 2025Updated last year
- This is a PyTorch implementation of 3DRefTR proposed by our paper "A Unified Framework for 3D Point Cloud Visual Grounding"☆26Aug 24, 2023Updated 3 years ago
- [ICLR 2025 Oral] Seer: Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation☆313Jul 8, 2025Updated last year