IDEA-FinAI / ChartMoE
[ICLR2025 Oral] ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understanding
β36Updated last week
Alternatives and similar repositories for ChartMoE:
Users that are interested in ChartMoE are comparing it to the libraries listed below
- [EMNLP 2024 Findingsπ₯] Official implementation of ": D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Largβ¦β92Updated 4 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*β95Updated 2 weeks ago
- (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reductionβ72Updated last week
- A Self-Training Framework for Vision-Language Reasoningβ69Updated last month
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Modelsβ116Updated 9 months ago
- Official repository of MMDU datasetβ86Updated 5 months ago
- [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Modelsβ64Updated 5 months ago
- Official implement of MIA-DPOβ52Updated last month
- Code release for VTW (AAAI 2025) Oralβ33Updated last month
- β48Updated this week
- β66Updated 2 months ago
- [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"β168Updated 5 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability ofβ¦β114Updated 3 months ago
- official code for "BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning"β33Updated last month
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Modelsβ47Updated 8 months ago
- MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Modelsβ26Updated last month
- β¨β¨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?β96Updated last week
- [AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Visioβ¦β23Updated last month
- [CVPR 2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".β124Updated last week
- β51Updated 7 months ago
- The official repository for the paper "Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark"β43Updated last month
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Moβ¦β72Updated last month
- Official implementation of the Law of Vision Representation in MLLMsβ150Updated 3 months ago
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encodingβ30Updated 3 months ago
- [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillationβ98Updated last month
- A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repoβ33Updated 7 months ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'β148Updated last month
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"β130Updated 4 months ago