opendatalab / CHARM
[ACL 2024 Main Conference] Chinese commonsense benchmark for LLMs
☆33Updated 8 months ago
Alternatives and similar repositories for CHARM:
Users that are interested in CHARM are comparing it to the libraries listed below
- MMR1: Advancing the Frontiers of Multimodal Reasoning☆155Updated last month
- ☆72Updated 10 months ago
- AAAI 2024: Visual Instruction Generation and Correction☆92Updated last year
- A RLHF Infrastructure for Vision-Language Models☆171Updated 5 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆115Updated 5 months ago
- A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.☆56Updated last month
- This is the repo for the paper Multi-Agent Collaborative Data Selection for Efficient LLM Pretraining.☆39Updated 4 months ago
- ☆41Updated 2 weeks ago
- Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models☆84Updated 9 months ago
- A Self-Training Framework for Vision-Language Reasoning☆76Updated 3 months ago
- An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.☆114Updated 2 weeks ago
- ☆98Updated last year
- ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆111Updated last month
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆46Updated last year
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆75Updated last week
- ☆25Updated 11 months ago
- Official repository of MMDU dataset☆89Updated 6 months ago
- [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"☆123Updated 10 months ago
- The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.☆22Updated last year
- R1-Vision: Let's first take a look at the image☆46Updated 2 months ago
- A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo☆33Updated 8 months ago
- ☆93Updated last week
- Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations☆80Updated 9 months ago
- [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation☆58Updated 4 months ago
- ☆81Updated last year
- This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…☆105Updated 6 months ago
- [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.☆103Updated 2 weeks ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆46Updated last year
- An Arena-style Automated Evaluation Benchmark for Detailed Captioning☆30Updated 3 weeks ago
- Paper collections of multi-modal LLM for Math/STEM/Code.☆88Updated this week