StonyBrookNLP / appworldLinks
🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Paper.
☆245Updated last month
Alternatives and similar repositories for appworld
Users that are interested in appworld are comparing it to the libraries listed below
Sorting:
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆346Updated last year
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆243Updated 4 months ago
- Code for the paper 🌳 Tree Search for Language Model Agents☆213Updated last year
- [NeurIPS 2024] Agent Planning with World Knowledge Model☆148Updated 8 months ago
- AWM: Agent Workflow Memory☆316Updated 7 months ago
- A banchmark list for evaluation of large language models.☆140Updated last week
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆97Updated 5 months ago
- ☆239Updated last year
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆143Updated 9 months ago
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆126Updated 6 months ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆149Updated 10 months ago
- An Illusion of Progress? Assessing the Current State of Web Agents☆80Updated last month
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆194Updated last year
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization☆167Updated last year
- [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents☆394Updated last year
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆157Updated 2 months ago
- augmented LLM with self reflection☆131Updated last year
- This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'☆126Updated 3 months ago
- "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"☆80Updated 5 months ago
- [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?☆130Updated last year
- ☆116Updated 7 months ago
- VisualWebArena is a benchmark for multimodal agents.☆374Updated 10 months ago
- Towards Large Multimodal Models as Visual Foundation Agents☆236Updated 4 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆179Updated 5 months ago
- ☆315Updated 3 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆541Updated last month
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆160Updated last year
- FireAct: Toward Language Agent Fine-tuning☆282Updated last year
- Benchmarking LLMs with Challenging Tasks from Real Users☆241Updated 10 months ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆223Updated last year