OpenDFM / MULTI-BenchmarkLinks
MULTI-Benchmark: Multimodal Understanding Leaderboard with Text and Images
☆42Updated 2 months ago
Alternatives and similar repositories for MULTI-Benchmark
Users that are interested in MULTI-Benchmark are comparing it to the libraries listed below
Sorting:
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆43Updated last year
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆46Updated last year
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆104Updated last year
- ☆50Updated last year
- G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning☆78Updated 3 months ago
- Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…☆124Updated 3 months ago
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆55Updated 8 months ago
- ☆86Updated 7 months ago
- Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"☆58Updated 10 months ago
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆83Updated 7 months ago
- ☆74Updated last year
- Open-Pandora: On-the-fly Control Video Generation☆34Updated 9 months ago
- MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment☆35Updated last year
- [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model☆46Updated 9 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆106Updated 3 months ago
- Multimodal RewardBench☆46Updated 6 months ago
- SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Reward☆74Updated 3 weeks ago
- A Self-Training Framework for Vision-Language Reasoning☆82Updated 7 months ago
- Code for our Paper "All in an Aggregated Image for In-Image Learning"☆29Updated last year
- ☆65Updated last year
- VeriGUI: Verifiable Long-Chain GUI Dataset☆75Updated 3 weeks ago
- [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.☆115Updated 3 months ago
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆55Updated 9 months ago
- An Arena-style Automated Evaluation Benchmark for Detailed Captioning☆55Updated 3 months ago
- [ICML'25] Official code of paper "Fast Large Language Model Collaborative Decoding via Speculation"☆24Updated 2 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆115Updated 9 months ago
- code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"☆59Updated last year
- Official repository of MMDU dataset☆93Updated 11 months ago
- Unsupervised GRPO☆46Updated 2 months ago
- MiroTrain is an efficient and algorithm-first framework for post-training large agentic models.☆77Updated last week