τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
☆1,520Jul 2, 2026Updated last week
Alternatives and similar repositories for tau2-bench
Users that are interested in tau2-bench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code and Data for Tau-Bench☆1,312Mar 18, 2026Updated 3 months ago
- ☆187Oct 29, 2025Updated 8 months ago
- A Challenge on Dialog Systems with Retrieval Augmented Generation (FutureDial-RAG), Co-located with SLT2024 FutureDial-RAG Challenge☆11Aug 10, 2024Updated last year
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆236Apr 15, 2025Updated last year
- [ICLR 2026] VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications☆152Feb 22, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Complex Function Calling Benchmark.☆181Jan 20, 2025Updated last year
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆5,051Nov 13, 2025Updated 7 months ago
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆22,312Updated this week
- A dataset for training and evaluating LLMs on decision making about "when (not) to call" functions☆66Apr 29, 2025Updated last year
- xLAM: A Family of Large Action Models to Empower AI Agent Systems☆631Jun 2, 2026Updated last month
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,059Updated this week
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆3,546Feb 8, 2026Updated 5 months ago
- [ACL 2026] Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments☆51Apr 6, 2026Updated 3 months ago
- ☆4,558Apr 22, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆700Jul 29, 2025Updated 11 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆149Nov 26, 2024Updated last year
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,615Apr 24, 2026Updated 2 months ago
- Simple RL training for reasoning☆3,867Dec 23, 2025Updated 6 months ago
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Asy…☆9,756Updated this week
- [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step☆312Apr 3, 2024Updated 2 years ago
- ☆351May 24, 2025Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,467Jun 29, 2026Updated last week
- Gym-Anything: Turn any Software into an Agent Environment☆247Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- OneEdit: A Neural-Symbolic Collaboratively Knowledge Editing System.☆20Oct 14, 2024Updated last year
- [COLING 2025] NesTools: A Dataset for Evaluating Nested Tool Learning Abilities of Large Language Models☆18Jan 18, 2025Updated last year
- Official implementation of paper "ACON: Optimizing Context Compression for Long-horizon LLM Agents"☆95Oct 14, 2025Updated 8 months ago
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆448Feb 17, 2026Updated 4 months ago
- A Survey of Reinforcement Learning for Large Reasoning Models☆2,469Nov 9, 2025Updated 8 months ago
- Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"☆1,530Nov 26, 2025Updated 7 months ago
- C^3-Bench: The Things Real Disturbing LLM based Agent in Multi-Tasking☆38Mar 1, 2026Updated 4 months ago
- verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in…☆2,090Jun 9, 2026Updated last month
- A framework for few-shot evaluation of language models.☆13,205Jun 24, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Understanding R1-Zero-Like Training: A Critical Perspective☆1,265Aug 27, 2025Updated 10 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆423May 20, 2024Updated 2 years ago
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)☆707Jan 20, 2025Updated last year
- AllenAI's post-training codebase☆3,784Updated this week
- ☆13Apr 16, 2025Updated last year
- [ICML'24 Spotlight] "TravelPlanner: A Benchmark for Real-World Planning with Language Agents"☆524May 24, 2026Updated last month
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆74May 13, 2025Updated last year