[ICLR 2026] Computer Agent Arena: Toward Human-Centric Evaluation and Analysis of Computer-Use Agents
☆58Feb 26, 2026Updated last week
Alternatives and similar repositories for computer-agent-arena
Users that are interested in computer-agent-arena are comparing it to the libraries listed below
Sorting:
- [EMNLP'23] Code for Generating Data for Symbolic Language with Large Language Models☆18Oct 21, 2023Updated 2 years ago
- Code for paper ”Language Versatilists vs. Specialists: An Empirical Revisiting on Multilingual Transfer Ability“☆15Jun 13, 2023Updated 2 years ago
- ☆21May 24, 2024Updated last year
- [NeurIPS 2025 Spotlight] Scaling Computer-Use Grounding via UI Decomposition and Synthesis☆150Nov 6, 2025Updated 4 months ago
- ☆27Feb 26, 2023Updated 3 years ago
- A repository for the updated version of CoinRun used to collect MUGEN, a multimodal video-audio-text dataset. This repo contains scripts …☆13Jul 13, 2022Updated 3 years ago
- [EMNLP-2022 Findings] Code for paper “ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback”.☆27Feb 4, 2023Updated 3 years ago
- Unofficial implementation of 《Towards Photo-Realistic VisibleWatermark Removal with Conditional Generative Adversarial Networks》☆13Feb 24, 2023Updated 3 years ago
- 🍨 Gelato — From Data Curation to Reinforcement Learning: Building a Strong Grounding Model for Computer-Use Agents☆38Dec 22, 2025Updated 2 months ago
- Self-hosted GPT-4V api☆27Nov 6, 2023Updated 2 years ago
- This is a pip package implementing Reinforcement Learning algorithms in non-stationary environments supported by the OpenAI Gym toolkit.☆16Jun 28, 2024Updated last year
- ☆15Jul 9, 2025Updated 7 months ago
- A Survey on Interpretable Cross-modal Reasoning☆15Oct 12, 2023Updated 2 years ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆64Jul 8, 2024Updated last year
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Dec 29, 2024Updated last year
- ☆17Feb 20, 2023Updated 3 years ago
- Documentation site for fast-agent☆28Feb 27, 2026Updated last week
- UQ: Assessing Language Models on Unsolved Questions☆30Aug 26, 2025Updated 6 months ago
- [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments☆2,608Updated this week
- [ICML2025] Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction☆381Mar 7, 2025Updated last year
- [ICLR2025 Spotlight] Agent Trajectory Synthesis via Guiding Replay with Web Tutorials☆52Feb 21, 2025Updated last year
- This is a collection of resources for computer-use GUI agents, including videos, blogs, papers, and projects.☆516Nov 7, 2025Updated 3 months ago
- Using multiple LLMs for ensemble Forecasting☆16Jan 17, 2024Updated 2 years ago
- Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups☆51Dec 23, 2024Updated last year
- ☆16Jul 23, 2024Updated last year
- [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models☆19Mar 16, 2023Updated 2 years ago
- Resources regarding evML (edge verified machine learning)☆22Jan 4, 2025Updated last year
- Can Language Models Solve Olympiad Programming?☆123Jan 14, 2025Updated last year
- A custom Ai driven IDE☆27May 6, 2025Updated 10 months ago
- Collection of Materials on AI Agents☆44Feb 11, 2026Updated 3 weeks ago
- [ICML'24] SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large mult…☆830Feb 3, 2025Updated last year
- GUICourse: From General Vision Langauge Models to Versatile GUI Agents☆136Updated this week
- ☆20Nov 4, 2025Updated 4 months ago
- ☆27Jul 23, 2025Updated 7 months ago
- Paper collections of methods that using language to interact with environment, including interact with real world, simulated world or WWW…☆129Jul 26, 2023Updated 2 years ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆49Dec 22, 2023Updated 2 years ago
- Systematic evaluation framework that automatically rates overthinking behavior in large language models.☆96May 16, 2025Updated 9 months ago
- [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs☆24Sep 26, 2024Updated last year
- Retrieved Sequence Augmentation for Protein Representation Learning☆53Nov 1, 2023Updated 2 years ago