xiaoachen98 / Open-LLaVA-NeXT
An open-source implementation for training LLaVA-NeXT.
☆363Updated 2 months ago
Alternatives and similar repositories for Open-LLaVA-NeXT:
Users that are interested in Open-LLaVA-NeXT are comparing it to the libraries listed below
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆524Updated 7 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆250Updated 9 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆227Updated 3 weeks ago
- Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆113Updated last month
- ☆369Updated last month
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆150Updated 3 months ago
- ☆192Updated this week
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆202Updated 3 weeks ago
- EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders☆528Updated 3 months ago
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆263Updated last week
- [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding☆229Updated 3 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆157Updated 2 months ago
- MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆272Updated 3 weeks ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆101Updated 3 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆251Updated 6 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆84Updated 9 months ago
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆269Updated 6 months ago
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆98Updated 2 months ago
- A RLHF Infrastructure for Vision-Language Models☆145Updated 2 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆154Updated 3 months ago
- [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning☆266Updated 10 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆308Updated 6 months ago
- Align Anything: Training All-modality Model with Feedback☆422Updated last week
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆335Updated 2 weeks ago
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allo…☆302Updated 4 months ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆328Updated 3 weeks ago
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆223Updated 3 weeks ago
- [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(…☆265Updated 2 months ago
- Official Repository of ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning☆206Updated 3 months ago
- A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!☆123Updated last year