Code and Data for Tau-Bench
☆1,114Aug 28, 2025Updated 6 months ago
Alternatives and similar repositories for tau-bench
Users that are interested in tau-bench are comparing it to the libraries listed below
Sorting:
- τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment☆800Feb 11, 2026Updated 3 weeks ago
- xLAM: A Family of Large Action Models to Empower AI Agent Systems☆602Aug 21, 2025Updated 6 months ago
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆3,211Feb 8, 2026Updated last month
- Complex Function Calling Benchmark.☆165Jan 20, 2025Updated last year
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆649Jul 29, 2025Updated 7 months ago
- ☆171Oct 29, 2025Updated 4 months ago
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆382Feb 17, 2026Updated 2 weeks ago
- ☆4,390Jul 31, 2025Updated 7 months ago
- [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents☆136Feb 16, 2026Updated 3 weeks ago
- verl: Volcano Engine Reinforcement Learning for LLMs☆19,739Updated this week
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆4,437Feb 19, 2026Updated 2 weeks ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆396May 20, 2024Updated last year
- ☆242Nov 7, 2025Updated 4 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆220Apr 15, 2025Updated 10 months ago
- RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.☆2,527Feb 27, 2026Updated last week
- ☆52Oct 10, 2024Updated last year
- Simple RL training for reasoning☆3,830Dec 23, 2025Updated 2 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆2,011Dec 22, 2024Updated last year
- [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.☆5,544May 21, 2025Updated 9 months ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,341Feb 26, 2026Updated last week
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆4,135Nov 13, 2025Updated 3 months ago
- Companion code to https://arxiv.org/abs/2409.03797v2☆19Sep 18, 2025Updated 5 months ago
- MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Models☆58Jul 24, 2025Updated 7 months ago
- ☆28Feb 18, 2025Updated last year
- AllenAI's post-training codebase☆3,614Updated this week
- A framework for few-shot evaluation of language models.☆11,618Updated this week
- Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhan…☆1,616May 23, 2024Updated last year
- Democratizing Reinforcement Learning for LLMs☆5,196Updated this week
- WorkArena: How Capable are Web Agents at Solving Common Knowledge Work Tasks?☆237Feb 23, 2026Updated 2 weeks ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆1,656Updated this week
- Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"☆1,372Nov 26, 2025Updated 3 months ago
- [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step☆304Apr 3, 2024Updated last year
- Arena-Hard-Auto: An automatic LLM benchmark.☆1,006Jun 21, 2025Updated 8 months ago
- 800,000 step-level correctness labels on LLM solutions to MATH problems☆2,096Jun 1, 2023Updated 2 years ago
- ☆104Dec 6, 2024Updated last year
- ☆224Jun 2, 2025Updated 9 months ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆242May 5, 2024Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,324Updated this week
- OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …☆6,705Feb 27, 2026Updated last week