ZrrSkywalker / MAVIS
Mathematical Visual Instruction Tuning for Multi-modal Large Language Models
☆109Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for MAVIS
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆108Updated last month
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆214Updated 3 weeks ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆149Updated last month
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆85Updated 7 months ago
- An open-source implementation for training LLaVA-NeXT.☆395Updated 3 weeks ago
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆104Updated 2 weeks ago
- Evaluating Vision & Language Pretraining Models with Objects, Attributes and Relations. [EMNLP 2022]☆128Updated last month
- u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model☆138Updated 4 months ago
- Official repository of MMDU dataset☆75Updated last month
- A RLHF Infrastructure for Vision-Language Models☆104Updated this week
- 【NeurIPS 2024】Dense Connector for MLLMs☆140Updated last month
- ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI☆95Updated 4 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆563Updated 5 months ago
- WorldGPT: Empowering LLM as Multimodal World Model☆123Updated 3 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆102Updated 3 weeks ago
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆262Updated 4 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆269Updated 7 months ago
- Official implementation of "Towards Efficient Visual Adaption via Structural Re-parameterization".☆197Updated 7 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆129Updated 2 weeks ago
- Official implementation of the Law of Vision Representation in MLLMs☆134Updated this week
- ☆58Updated 9 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆108Updated 7 months ago
- ☆84Updated 10 months ago
- [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"☆148Updated last month
- [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs☆71Updated 2 weeks ago
- A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo☆31Updated 3 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆246Updated 4 months ago
- ✨✨ MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆78Updated last week
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆66Updated 9 months ago
- Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models☆67Updated 4 months ago