Alternatives and similar repositories for WorkArena:

Users that are interested in WorkArena are comparing it to the libraries listed below

• ServiceNow / AgentLab
  AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…
  ☆208Updated this week
• ServiceNow / BrowserGym
  🌎💪 BrowserGym, a Gym environment for web task automation
  ☆488Updated last week
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆194Updated this week
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆233Updated 2 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆136Updated last month
• web-arena-x / visualwebarena
  VisualWebArena is a benchmark for multimodal agents.
  ☆283Updated 2 months ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym
  ☆251Updated 2 weeks ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆167Updated 6 months ago
• asappresearch / webagents-step
  ☆38Updated 6 months ago
• princeton-nlp / WebShop
  [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents
  ☆302Updated 4 months ago
• mlfoundations / evalchemy
  Automatic Evals for LLMs
  ☆128Updated this week
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆82Updated 3 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆156Updated 3 months ago
• OSU-NLP-Group / UGround
  UGround: Universal GUI Visual Grounding for GUI Agents
  ☆147Updated this week
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆111Updated 2 months ago
• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆203Updated 8 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆172Updated this week
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆168Updated 3 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆97Updated this week
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆177Updated last month
• sierra-research / tau-bench
  Code and Data for Tau-Bench
  ☆258Updated last week
• vsubramaniam851 / multiagent-ft
  ☆148Updated 2 weeks ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆47Updated last month
• microsoft / LLF-Bench
  A benchmark for evaluating learning agents based on just language feedback
  ☆64Updated 3 months ago
• rgreenblatt / arc_draw_more_samples_pub
  Draw more samples
  ☆185Updated 7 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆125Updated 5 months ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆108Updated 2 weeks ago
• karthikv792 / LLMs-Planning
  An extensible benchmark for evaluating large language models on planning
  ☆318Updated 8 months ago
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆116Updated last year