Alternatives and similar repositories for mnms

Users that are interested in mnms are comparing it to the libraries listed below

• JIA-Lab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆51Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆63Updated last year
• open-compass / GTA
  [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents
  ☆133Updated 10 months ago
• RM-R1-UIUC / RM-R1
  RM-R1: Unleashing the Reasoning Potential of Reward Models
  ☆158Updated 7 months ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆148Updated last year
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆159Updated last year
• cathyxl / MAgIC
  ☆42Updated last year
• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆29Updated last year
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆31Updated last year
• OpenKG-ORG / EasyDetect
  An Easy-to-use Hallucination Detection Framework for LLMs.
  ☆63Updated last year
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆85Updated 8 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆139Updated 9 months ago
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆147Updated last year
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆65Updated last year
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆120Updated 9 months ago
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆62Updated 7 months ago
• declare-lab / LLM-PuzzleTest
  This repository is maintained to release dataset and models for multimodal puzzle reasoning.
  ☆113Updated 11 months ago
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆49Updated last year
• open-compass / CriticEval
  [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs
  ☆49Updated last year
• ltzheng / Synapse
  [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control
  ☆66Updated 3 weeks ago
• cs-holder / Reasoning-Self-Evolution-Survey
  ☆54Updated 11 months ago
• xufangzhi / Symbol-LLM
  [ACL 2024] The project of Symbol-LLM
  ☆59Updated last year
• open-compass / Ada-LEval
  The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"
  ☆56Updated 8 months ago
• xufangzhi / ENVISIONS
  [ACL 2025] A Neural-Symbolic Self-Training Framework
  ☆117Updated 8 months ago
• vlf-silkie / VLFeedback
  ☆101Updated 2 years ago
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆73Updated last year
• pkunlp-icler / PCA-EVAL
  [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain
  ☆106Updated last year
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆68Updated 6 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆103Updated 2 years ago
• NVlabs / Tool-N1
  ☆219Updated 8 months ago