sierra-research / tau2-benchLinks
τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
☆258Updated 2 weeks ago
Alternatives and similar repositories for tau2-bench
Users that are interested in tau2-bench are comparing it to the libraries listed below
Sorting:
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆245Updated last month
- Benchmarking Chat Assistants on Long-Term Interactive Memory (ICLR 2025)☆197Updated 4 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆243Updated 4 months ago
- Code for the paper 🌳 Tree Search for Language Model Agents☆213Updated last year
- AWM: Agent Workflow Memory☆312Updated 7 months ago
- Scaling Data for SWE-agents☆392Updated last week
- Reproducible, flexible LLM evaluations☆244Updated 2 months ago
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆157Updated 2 months ago
- ☆270Updated last month
- ☆239Updated last year
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆272Updated this week
- ☆227Updated last year
- LOFT: A 1 Million+ Token Long-Context Benchmark☆209Updated 3 months ago
- A simple unified framework for evaluating LLMs☆243Updated 4 months ago
- Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)☆158Updated 2 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆97Updated 5 months ago
- ☆204Updated last year
- ☆315Updated 3 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆346Updated last year
- A banchmark list for evaluation of large language models.☆140Updated this week
- AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…☆399Updated last week
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆160Updated last year
- Complex Function Calling Benchmark.☆132Updated 7 months ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆194Updated last year
- Benchmarking LLMs with Challenging Tasks from Real Users☆241Updated 10 months ago
- Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".☆198Updated 2 months ago
- Code for the paper: "Learning to Reason without External Rewards"☆351Updated 2 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆541Updated last month
- ☆205Updated last month
- An Illusion of Progress? Assessing the Current State of Web Agents☆80Updated last month