VITA-MLLM / Long-VITA
✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy
☆263Updated last week
Alternatives and similar repositories for Long-VITA:
Users that are interested in Long-VITA are comparing it to the libraries listed below
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆288Updated this week
- An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆112Updated 3 weeks ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆107Updated this week
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆282Updated 2 months ago
- (NeurIPS 2024) Official PyTorch implementation of LOVA3☆79Updated this week
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆92Updated last year
- A collection of multimodal reasoning papers, codes, datasets, benchmarks and resources.☆122Updated this week
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache☆43Updated 8 months ago
- ☆132Updated 2 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆170Updated 4 months ago
- Official implementation of X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models☆152Updated 3 months ago
- [ICLR 2025] BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities☆139Updated 2 months ago
- u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model☆130Updated 8 months ago
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆285Updated 8 months ago
- [CVPR 2025] The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆177Updated this week
- ☆95Updated this week
- [NAACL 2025 Oral] 🎉 From redundancy to relevance: Enhancing explainability in multimodal large language models☆87Updated last month
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆241Updated 3 months ago
- 🚀 [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'2…☆74Updated this week
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆113Updated 11 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆297Updated last month
- [ICLR 2025] Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆130Updated 3 months ago
- CoS: Chain-of-Shot Prompting for Long Video Understanding☆44Updated last month
- The Next Step Forward in Multimodal LLM Alignment☆135Updated 3 weeks ago
- An open-source implementation for training LLaVA-NeXT.☆385Updated 5 months ago
- Official code base for paper EZIGen: Enhancing zero-shot personalized image generation with precise subject encoding and decoupled guidan…☆102Updated this week
- [NeurIPS 2024] AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation☆95Updated 5 months ago
- a family of versatile and state-of-the-art video tokenizers.☆354Updated this week
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆319Updated 3 weeks ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆156Updated 6 months ago