xiaoachen98 / Open-LLaVA-NeXT
An open-source implementation for training LLaVA-NeXT.
☆386Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for Open-LLaVA-NeXT
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆557Updated 5 months ago
- Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆109Updated 3 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆269Updated 6 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆211Updated 2 weeks ago
- ☆365Updated 6 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆148Updated last month
- MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆286Updated this week
- EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders☆535Updated last month
- OmniTokenizer: one model and one weight for image-video joint tokenization.☆255Updated 4 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆108Updated 3 weeks ago
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆102Updated this week
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆244Updated 4 months ago
- [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning☆254Updated 7 months ago
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆264Updated this week
- ☆356Updated 5 months ago
- [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding☆204Updated last month
- Evaluating text-to-image/video/3D models with VQAScore☆220Updated 2 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆86Updated 7 months ago
- [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models☆227Updated last month
- ☆287Updated 9 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆128Updated 2 months ago
- SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆236Updated this week
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆294Updated 3 months ago
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allo…☆283Updated 2 months ago
- LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images☆318Updated last month
- Official Repository of ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning☆211Updated last month
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,260Updated last month
- [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(…☆242Updated this week
- WorldGPT: Empowering LLM as Multimodal World Model☆123Updated 3 months ago
- 【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?☆238Updated last month