sierra-research / tau2-benchLinks
τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
☆149Updated 3 weeks ago
Alternatives and similar repositories for tau2-bench
Users that are interested in tau2-bench are comparing it to the libraries listed below
Sorting:
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆238Updated this week
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆234Updated this week
- Benchmarking Chat Assistants on Long-Term Interactive Memory (ICLR 2025)☆167Updated 3 months ago
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆69Updated 2 months ago
- Code for the paper 🌳 Tree Search for Language Model Agents☆208Updated last year
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆91Updated 4 months ago
- ☆64Updated 2 weeks ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆140Updated 8 months ago
- Code that accompanies the public release of the paper Lost in Conversation (https://arxiv.org/abs/2505.06120)☆150Updated last month
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆233Updated 3 months ago
- Can Language Models Solve Olympiad Programming?☆118Updated 6 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆234Updated 9 months ago
- Scaling Data for SWE-agents☆342Updated last week
- Code for the paper: "Learning to Reason without External Rewards"☆344Updated last month
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆139Updated 9 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆176Updated 5 months ago
- Complex Function Calling Benchmark.☆123Updated 6 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆208Updated last month
- ☆119Updated 5 months ago
- Critique-out-Loud Reward Models☆70Updated 9 months ago
- Scaling Computer-Use Grounding via UI Decomposition and Synthesis☆98Updated last month
- ☆70Updated 2 months ago
- ☆100Updated 2 months ago
- ☆82Updated last month
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆191Updated last year
- ☆114Updated 6 months ago
- Self-playing Adversarial Language Game Enhances LLM Reasoning, NeurIPS 2024☆137Updated 5 months ago
- WorkArena: How Capable are Web Agents at Solving Common Knowledge Work Tasks?☆201Updated last week
- A simple unified framework for evaluating LLMs☆236Updated 3 months ago
- AWM: Agent Workflow Memory☆300Updated 6 months ago