StonyBrookNLP / appworldLinks
🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Paper.
☆221Updated 2 months ago
Alternatives and similar repositories for appworld
Users that are interested in appworld are comparing it to the libraries listed below
Sorting:
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆223Updated 2 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆329Updated last year
- A banchmark list for evaluation of large language models.☆130Updated 2 weeks ago
- Code for the paper 🌳 Tree Search for Language Model Agents☆205Updated 11 months ago
- AWM: Agent Workflow Memory☆291Updated 5 months ago
- [NeurIPS 2024] Agent Planning with World Knowledge Model☆141Updated 6 months ago
- ☆234Updated 11 months ago
- augmented LLM with self reflection☆129Updated last year
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆138Updated 7 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆207Updated this week
- "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"☆78Updated 3 months ago
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization☆154Updated last year
- This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'☆118Updated last month
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆88Updated 3 months ago
- A simple unified framework for evaluating LLMs☆221Updated 3 months ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆188Updated 11 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆154Updated last year
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆106Updated 4 months ago
- Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆112Updated last week
- ☆114Updated 5 months ago
- ☆319Updated 9 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆160Updated 3 months ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆146Updated 8 months ago
- Reproducible, flexible LLM evaluations☆219Updated this week
- Building Open LLM Web Agents with Self-Evolving Online Curriculum RL☆420Updated last month
- VisualWebArena is a benchmark for multimodal agents.☆357Updated 8 months ago
- FireAct: Toward Language Agent Fine-tuning☆279Updated last year
- [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning☆229Updated 6 months ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆100Updated last month
- Benchmarking LLMs with Challenging Tasks from Real Users☆228Updated 8 months ago