ZrrSkywalker / MAVIS
Mathematical Visual Instruction Tuning for Multi-modal Large Language Models
☆109Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for MAVIS
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆148Updated last month
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆211Updated 2 weeks ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆108Updated 3 weeks ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆86Updated 7 months ago
- An open-source implementation for training LLaVA-NeXT.☆386Updated 2 weeks ago
- Evaluating Vision & Language Pretraining Models with Objects, Attributes and Relations. [EMNLP 2022]☆128Updated last month
- u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model☆137Updated 3 months ago
- WorldGPT: Empowering LLM as Multimodal World Model☆123Updated 3 months ago
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.☆102Updated this week
- OmniTokenizer: one model and one weight for image-video joint tokenization.☆255Updated 4 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆269Updated 6 months ago
- A RLHF Infrastructure for Vision-Language Models☆98Updated 4 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆557Updated 5 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]☆108Updated 6 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆98Updated 2 weeks ago
- [CVPR 2023] Official implementation of the paper: Fine-grained Audible Video Description☆74Updated 11 months ago
- Official implementation of "Towards Efficient Visual Adaption via Structural Re-parameterization".☆197Updated 6 months ago
- ☆72Updated 8 months ago
- [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"☆145Updated last month
- Official repository of MMDU dataset☆74Updated last month
- Official implementation of the Law of Vision Representation in MLLMs☆128Updated 2 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆98Updated 5 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆133Updated 3 weeks ago
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆64Updated 9 months ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆88Updated last month
- [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models☆227Updated last month
- Official Repository of ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning☆211Updated last month
- GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Recognition?☆207Updated 5 months ago
- ☆84Updated 10 months ago
- ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI☆93Updated 3 months ago