MultiagentBench / MARBLE
Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.01935
☆100Updated last month
Alternatives and similar repositories for MARBLE
Users that are interested in MARBLE are comparing it to the libraries listed below
Sorting:
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆193Updated last week
- ☆181Updated 3 weeks ago
- DSBench: How Far are Data Science Agents from Becoming Data Science Experts?☆52Updated 2 months ago
- A banchmark list for evaluation of large language models.☆108Updated 2 weeks ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆173Updated 2 months ago
- Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆90Updated 2 months ago
- official repository for “Reinforcement Learning for Reasoning in Large Language Models with One Training Example”☆143Updated last week
- Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"☆97Updated 6 months ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆142Updated this week
- ☆110Updated 3 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples☆85Updated last month
- Resources for our paper: "Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training"☆132Updated last month
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆76Updated last month
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆135Updated 5 months ago
- ☆201Updated 2 months ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆89Updated last month
- Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"☆105Updated 7 months ago
- ☆100Updated last month
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆121Updated 2 weeks ago
- augmented LLM with self reflection☆121Updated last year
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆58Updated last month
- ☆27Updated this week
- ☆120Updated 7 months ago
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆92Updated 2 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆146Updated 3 weeks ago
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆193Updated this week
- ☆46Updated last week
- Codebase accompanying the Summary of a Haystack paper.☆78Updated 7 months ago
- [NeurIPS 2024] Agent Planning with World Knowledge Model☆134Updated 5 months ago
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning☆53Updated last month