RAIVNLab / mnmsLinks
m&ms: A Benchmark to Evaluate Tool-Use for multi-step multi-modal tasks
☆42Updated 11 months ago
Alternatives and similar repositories for mnms
Users that are interested in mnms are comparing it to the libraries listed below
Sorting:
- ☆41Updated 10 months ago
- RM-R1: Unleashing the Reasoning Potential of Reward Models☆134Updated 2 months ago
- Official Implementation of ARPO: End-to-End Policy Optimization for GUI Agents with Experience Replay☆122Updated 3 months ago
- Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"☆59Updated 11 months ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆149Updated 10 months ago
- This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"☆50Updated 10 months ago
- ☆49Updated 6 months ago
- [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents☆124Updated 5 months ago
- [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.☆73Updated 9 months ago
- A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…☆56Updated 3 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆143Updated 9 months ago
- B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners☆84Updated 4 months ago
- [ACL 2025] A Neural-Symbolic Self-Training Framework☆112Updated 3 months ago
- [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning☆111Updated 4 months ago
- Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073☆30Updated last year
- ☆206Updated 3 months ago
- ☆31Updated 11 months ago
- An Easy-to-use Hallucination Detection Framework for LLMs.☆62Updated last year
- ☆108Updated last month
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆51Updated 3 months ago
- Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"☆47Updated 3 months ago
- Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting☆33Updated last year
- [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios☆63Updated last month
- ReasonFlux-Coder: Open-Source LLM Coders with Co-Evolving Reinforcement Learning☆115Updated 3 weeks ago
- The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]☆88Updated 5 months ago
- [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models☆62Updated 9 months ago
- Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)☆60Updated 11 months ago
- [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control☆60Updated 8 months ago
- Interpretable Contrastive Monte Carlo Tree Search Reasoning☆48Updated 10 months ago
- ☆31Updated last year