Alternatives and similar repositories for mnms

Users that are interested in mnms are comparing it to the libraries listed below

• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆50Updated 8 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆57Updated 9 months ago
• open-compass / GTA
  [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents
  ☆112Updated 3 months ago
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆71Updated 7 months ago
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆57Updated last year
• OpenKG-ORG / EasyDetect
  An Easy-to-use Hallucination Detection Framework for LLMs.
  ☆59Updated last year
• cathyxl / MAgIC
  ☆41Updated 8 months ago
• dvlab-research / ARPO
  Official Implementation of ARPO: End-to-End Policy Optimization for GUI Agents with Experience Replay
  ☆89Updated last month
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆29Updated last year
• YuxiangChai / AMEX-codebase
  ☆29Updated 9 months ago
• TIGER-AI-Lab / AceCoder
  The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]
  ☆88Updated 3 months ago
• RM-R1-UIUC / RM-R1
  RM-R1: Unleashing the Reasoning Potential of Reward Models
  ☆113Updated 3 weeks ago
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆50Updated last month
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆51Updated last month
• gzcch / Bingo
  ☆55Updated last year
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆120Updated 2 months ago
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆47Updated 2 months ago
• ltzheng / SimpleTIR
  End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning
  ☆127Updated this week
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆146Updated 8 months ago
• cognitiveailab / GPT-simulator
  ☆26Updated last year
• BytedTsinghua-SIA / Enigmata
  Resources for the Enigmata Project.
  ☆53Updated last month
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆62Updated 7 months ago
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆46Updated last month
• cs-holder / Reasoning-Self-Evolution-Survey
  ☆47Updated 4 months ago
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆68Updated 2 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆60Updated 9 months ago
• ltzheng / Synapse
  [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control
  ☆59Updated 6 months ago
• umd-huang-lab / Mementos
  ☆31Updated last year
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆82Updated last month
• xufangzhi / Symbol-LLM
  [ACL 2024] The project of Symbol-LLM
  ☆56Updated last year