Alternatives and similar repositories for appworld:

Users that are interested in appworld are comparing it to the libraries listed below

• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆130Updated 3 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆218Updated 4 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆118Updated 9 months ago
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]
  ☆291Updated 10 months ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆186Updated 8 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆252Updated last month
• kanishkg / cognitive-behaviors
  ☆128Updated this week
• sotopia-lab / sotopia
  Sotopia: an Open-ended Social Learning Environment (ICLR 2024 spotlight)
  ☆201Updated this week
• OSU-NLP-Group / WebDreamer
  ☆58Updated 3 months ago
• ScalerLab / JudgeBench
  ☆65Updated 4 months ago
• zhangxjohn / LLM-Agent-Benchmark-List
  A banchmark list for evaluation of large language models.
  ☆87Updated 2 weeks ago
• jwhj / OREO
  ☆103Updated 2 months ago
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆120Updated 3 months ago
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆135Updated 2 weeks ago
• OSU-NLP-Group / GUI-Agents-Paper-List
  Building a comprehensive and handy list of papers for GUI agents
  ☆260Updated last week
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• SALT-NLP / collaborative-gym
  Framework and toolkits for building and evaluating collaborative agents that can work together with humans.
  ☆70Updated last month
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆206Updated 2 weeks ago
• zorazrw / awesome-tool-llm
  ☆217Updated 7 months ago
• zjunlp / AutoAct
  [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning
  ☆215Updated 2 months ago
• QwenLM / ProcessBench
  ☆143Updated 3 months ago
• princeton-nlp / WebShop
  [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents
  ☆313Updated 6 months ago
• microsoft / simulated-trial-and-error
  ☆120Updated 9 months ago
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆117Updated last year
• eddycmu / demystify-long-cot
  ☆260Updated last week
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆180Updated last week
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆131Updated 4 months ago
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆130Updated 6 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆176Updated 3 months ago
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆131Updated last year