xiaoachen98 / Open-LLaVA-NeXT
An open-source implementation for training LLaVA-NeXT.
☆385Updated 5 months ago
Alternatives and similar repositories for Open-LLaVA-NeXT:
Users that are interested in Open-LLaVA-NeXT are comparing it to the libraries listed below
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆554Updated 9 months ago
- [ICLR 2025] Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆130Updated 3 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆239Updated 2 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆255Updated 11 months ago
- ☆378Updated 3 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆156Updated 6 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆297Updated 3 weeks ago
- Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs☆628Updated last month
- An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆112Updated 2 weeks ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆171Updated 4 months ago
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆259Updated last week
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆274Updated 3 months ago
- [NAACL 2025 Oral] 🎉 From redundancy to relevance: Enhancing explainability in multimodal large language models☆87Updated last month
- Investigating CoT Reasoning in Autoregressive Image Generation☆559Updated this week
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆104Updated 5 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆257Updated 9 months ago
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆282Updated 2 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆315Updated 8 months ago
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆263Updated this week
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆266Updated 6 months ago
- Official repository for VisionZip (CVPR 2025)☆256Updated 3 weeks ago
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆285Updated 8 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆92Updated last year
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allo…☆323Updated 7 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆157Updated 5 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆151Updated 4 months ago
- [CVPR 2025] The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆174Updated 3 weeks ago
- A jounery to real multimodel R1 ! We are doing on large-scale experiment☆280Updated 2 weeks ago
- A RLHF Infrastructure for Vision-Language Models☆167Updated 4 months ago
- [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning☆272Updated last year