StonyBrookNLP / appworld
🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Paper.
☆179Updated this week
Alternatives and similar repositories for appworld:
Users that are interested in appworld are comparing it to the libraries listed below
- Code for the paper 🌳 Tree Search for Language Model Agents☆192Updated 8 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆175Updated this week
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆132Updated 4 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆140Updated 2 weeks ago
- ☆151Updated 2 weeks ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆303Updated 10 months ago
- ☆105Updated 2 months ago
- ☆218Updated 8 months ago
- "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"☆65Updated this week
- AWM: Agent Workflow Memory☆256Updated 2 months ago
- A banchmark list for evaluation of large language models.☆99Updated last month
- ☆148Updated 3 months ago
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆101Updated 2 months ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆185Updated 8 months ago
- ☆164Updated last month
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆122Updated 10 months ago
- ☆121Updated 10 months ago
- [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents☆326Updated 7 months ago
- This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.☆301Updated 8 months ago
- (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training☆262Updated 10 months ago
- Repo of paper "Free Process Rewards without Process Labels"☆140Updated last month
- VisualWebArena is a benchmark for multimodal agents.☆332Updated 5 months ago
- Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples☆84Updated 3 weeks ago
- Sotopia: an Open-ended Social Learning Environment (ICLR 2024 spotlight)☆206Updated this week
- ☆278Updated 3 weeks ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆160Updated last year
- This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'☆106Updated 2 months ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆133Updated 5 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆221Updated 5 months ago
- A simple unified framework for evaluating LLMs☆210Updated this week