XiaomiMiMo / lmms-evalLinks
Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.
☆54Updated 2 weeks ago
Alternatives and similar repositories for lmms-eval
Users that are interested in lmms-eval are comparing it to the libraries listed below
Sorting:
- [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding☆55Updated 8 months ago
- MMR1: Advancing the Frontiers of Multimodal Reasoning☆162Updated 5 months ago
- This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"☆36Updated last year
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆105Updated 2 months ago
- G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning☆78Updated 3 months ago
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆98Updated 9 months ago
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"☆139Updated 2 months ago
- Official repository of MMDU dataset☆93Updated 10 months ago
- ☆100Updated last year
- The official repo of One RL to See Them All: Visual Triple Unified Reinforcement Learning☆310Updated 2 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆115Updated 9 months ago
- SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models☆132Updated 4 months ago
- GPG: A Simple and Strong Reinforcement Learning Baseline for Model Reasoning☆159Updated 3 months ago
- ☆46Updated 4 months ago
- 🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training☆87Updated 8 months ago
- NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation☆85Updated last week
- MiroTrain is an efficient and algorithm-first framework for post-training large agentic models.☆75Updated last week
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆138Updated 4 months ago
- A Self-Training Framework for Vision-Language Reasoning☆82Updated 7 months ago
- Official repo for "PAPO: Perception-Aware Policy Optimization for Multimodal Reasoning"☆80Updated 2 weeks ago
- Extrapolating RLVR to General Domains without Verifiers☆140Updated last week
- ☆85Updated 7 months ago
- A RLHF Infrastructure for Vision-Language Models☆181Updated 9 months ago
- "what, how, where, and how well? a survey on test-time scaling in large language models" repository☆62Updated this week
- Open-Pandora: On-the-fly Control Video Generation☆34Updated 8 months ago
- ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆128Updated 5 months ago
- An Arena-style Automated Evaluation Benchmark for Detailed Captioning☆54Updated 2 months ago
- MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search too…☆292Updated 2 weeks ago
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆55Updated 9 months ago
- Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.☆147Updated last month