ZrrSkywalker / MathVerse
[ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?
☆148Updated last month
Related projects ⓘ
Alternatives and complementary repositories for MathVerse
- Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆109Updated 3 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆269Updated 6 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆86Updated 7 months ago
- An open-source implementation for training LLaVA-NeXT.☆386Updated 2 weeks ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆211Updated 2 weeks ago
- WorldGPT: Empowering LLM as Multimodal World Model☆123Updated 3 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆557Updated 5 months ago
- Official Repository of ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning☆211Updated last month
- u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model☆137Updated 3 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆108Updated 3 weeks ago
- ☆72Updated 8 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆98Updated 2 weeks ago
- MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆286Updated this week
- ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI☆93Updated 3 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆128Updated 2 months ago
- ☆365Updated 6 months ago
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆132Updated 2 months ago
- ☆356Updated 5 months ago
- [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models☆227Updated last month
- [NeurIPS 2024] Matryoshka Query Transformer for Large Vision-Language Models☆97Updated 4 months ago
- [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"☆145Updated last month
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆102Updated this week
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆122Updated last week
- Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"☆163Updated 2 months ago
- ☆131Updated 10 months ago
- A RLHF Infrastructure for Vision-Language Models☆98Updated 4 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆244Updated 4 months ago
- OmniTokenizer: one model and one weight for image-video joint tokenization.☆255Updated 4 months ago
- The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.☆21Updated 8 months ago
- Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆113Updated last month