njucckevin / SeeClick
The model, data and code for the visual GUI Agent SeeClick
β323Updated 3 months ago
Alternatives and similar repositories for SeeClick:
Users that are interested in SeeClick are comparing it to the libraries listed below
- [ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agentsβ176Updated this week
- Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)β220Updated 7 months ago
- π» A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.β511Updated this week
- Building a comprehensive and handy list of papers for GUI agentsβ227Updated last week
- GUICourse: From General Vision Langauge Models to Versatile GUI Agentsβ104Updated 7 months ago
- Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactionβ245Updated last month
- Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)β76Updated 4 months ago
- β192Updated 3 months ago
- OS-ATLAS: A Foundation Action Model For Generalist GUI Agentsβ287Updated last week
- Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.β313Updated last week
- Building Open LLM Web Agents with Self-Evolving Online Curriculum RLβ315Updated 3 weeks ago
- Towards Large Multimodal Models as Visual Foundation Agentsβ190Updated 3 weeks ago
- Code and data for OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesisβ108Updated last month
- GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes frβ¦β90Updated 3 months ago
- VisualWebArena is a benchmark for multimodal agents.β306Updated 3 months ago
- β¨β¨Latest Papers and Datasets on Mobile and PC GUI Agentβ103Updated 3 months ago
- AndroidWorld is an environment and benchmark for autonomous agentsβ218Updated last week
- GitHub page for "Large Language Model-Brained GUI Agents: A Survey"β121Updated this week
- This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Eβ¦β397Updated last month
- A Universal Platform for Training and Evaluation of Mobile Interactionβ41Updated this week
- β409Updated 5 months ago
- AWM: Agent Workflow Memoryβ245Updated last month
- [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Stepβ261Updated 11 months ago
- [ICLR 2025] A trinity of environments, tools, and benchmarks for general virtual agentsβ195Updated last week
- This is a collection of resources for computer-use GUI agents, including videos, blogs, papers, and projects.β241Updated this week
- PC Agent: While You Sleep, AI Works - A Cognitive Journey into Digital Worldβ186Updated 2 months ago
- ScreenAgent: A Computer Control Agent Driven by Visual Language Large Model (IJCAI-24)β406Updated 3 months ago
- ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K β¦β104Updated 3 weeks ago
- [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planningβ211Updated last month
- (ICLR 2025) The Official Code Repository for GUI-World.β52Updated 2 months ago