StonyBrookNLP / appworldLinks
π AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource Paper.
β324Updated 3 weeks ago
Alternatives and similar repositories for appworld
Users that are interested in appworld are comparing it to the libraries listed below
Sorting:
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasksβ253Updated 7 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]β368Updated last year
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.β110Updated last month
- A banchmark list for evaluation of large language models.β151Updated 2 months ago
- Code for the paper π³ Tree Search for Language Model Agentsβ216Updated last year
- AWM: Agent Workflow Memoryβ359Updated 10 months ago
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike statβ¦β377Updated 2 weeks ago
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agentsβ204Updated 4 months ago
- [NeurIPS 2024] Agent Planning with World Knowledge Modelβ156Updated 11 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.β198Updated 7 months ago
- β327Updated 6 months ago
- β216Updated 8 months ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safetyβ202Updated last year
- An Illusion of Progress? Assessing the Current State of Web Agentsβ113Updated last week
- [NeurIPS 2022] πWebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentsβ436Updated last year
- [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agentsβ129Updated 8 months ago
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimizationβ181Updated last year
- β241Updated last year
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]β147Updated last year
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)β159Updated last year
- A simple unified framework for evaluating LLMsβ254Updated 7 months ago
- [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?β134Updated last year
- β117Updated 10 months ago
- [TMLR'25] "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"β94Updated 2 months ago
- [ICLR 2025] Benchmarking Agentic Workflow Generationβ135Updated 9 months ago
- Building Open LLM Web Agents with Self-Evolving Online Curriculum RLβ479Updated 5 months ago
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)β264Updated last year
- Resources for our paper: "Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training"β161Updated last month
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Zihaβ¦β134Updated last year
- Towards Large Multimodal Models as Visual Foundation Agentsβ244Updated 7 months ago