THUDM / VisualAgentBench
Towards Large Multimodal Models as Visual Foundation Agents
☆192Updated last month
Alternatives and similar repositories for VisualAgentBench:
Users that are interested in VisualAgentBench are comparing it to the libraries listed below
- Code and data for OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis☆112Updated last week
- GUICourse: From General Vision Langauge Models to Versatile GUI Agents☆103Updated 8 months ago
- [ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents☆185Updated 2 weeks ago
- The model, data and code for the visual GUI Agent SeeClick☆336Updated 3 months ago
- Building a comprehensive and handy list of papers for GUI agents☆246Updated this week
- GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…☆93Updated 4 months ago
- Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)☆223Updated 8 months ago
- Building Open LLM Web Agents with Self-Evolving Online Curriculum RL☆324Updated last month
- Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)☆76Updated 5 months ago
- ☆124Updated 3 months ago
- Code for NeurIPS 2024 paper "AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learning"☆37Updated 4 months ago
- VisualWebArena is a benchmark for multimodal agents.☆317Updated 4 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆129Updated 3 months ago
- ✨✨Latest Papers and Datasets on Mobile and PC GUI Agent☆112Updated 3 months ago
- Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction☆256Updated last week
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆289Updated 9 months ago
- Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.☆330Updated 3 weeks ago
- ☆195Updated 3 months ago
- Code and implementations for the paper "AgentGym: Evolving Large Language Model-based Agents across Diverse Environments" by Zhiheng Xi e…☆414Updated last week
- AndroidWorld is an environment and benchmark for autonomous agents☆238Updated this week
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆127Updated 4 months ago
- A Universal Platform for Training and Evaluation of Mobile Interaction☆42Updated 3 weeks ago
- [NeurIPS 2024] Official Implementation for Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks☆67Updated last week
- Code for the paper 🌳 Tree Search for Language Model Agents☆184Updated 7 months ago
- [NeurIPS 2024] Agent Planning with World Knowledge Model☆116Updated 3 months ago
- [NeurIPS 2024 D&B Track] GTA: A Benchmark for General Tool Agents☆78Updated last month
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆157Updated 3 months ago
- ☆120Updated 9 months ago