OSU-NLP-Group / UGround

Related projects ⓘ

Alternatives and complementary repositories for UGround

• OS-Copilot / OS-Atlas
  OS-ATLAS: A Foundation Action Model For Generalist GUI Agents
  ☆118Updated this week
• boyugou / llava_uground
  ☆10Updated last week
• siyuyuan / evoagent
  Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"
  ☆75Updated 3 weeks ago
• computer-agents / agent-studio
  Environments, tools, and benchmarks for general computer agents
  ☆171Updated 2 weeks ago
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆37Updated 3 weeks ago
• THUDM / WebRL
  Building Open LLM Web Agents with Self-Evolving Online Curriculum RL
  ☆147Updated this week
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆94Updated 2 weeks ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆106Updated 2 weeks ago
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆138Updated 3 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆203Updated last month
• ltzheng / Synapse
  [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control
  ☆49Updated 2 months ago
• asappresearch / webagents-step
  ☆38Updated 3 months ago
• microsoft / simulated-trial-and-error
  ☆116Updated 5 months ago
• yiye3 / GUICourse
  GUICourse: From General Vision Langauge Models to Versatile GUI Agents
  ☆78Updated 3 months ago
• Yushi-Hu / VisualSketchpad
  Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  ☆121Updated last week
• Dongping-Chen / GUI-World
  The Official Code Repository for GUI-World.
  ☆36Updated 3 months ago
• McGill-NLP / weblinx
  WebLINX is a benchmark for building web navigation agents with conversational capabilities
  ☆116Updated last month
• ranpox / awesome-computer-use
  This is a collection of resources for computer-use agents, including videos, blogs, papers, and projects.
  ☆83Updated this week
• Yifan-Song793 / ETO
  Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)
  ☆96Updated last week
• THUDM / VisualAgentBench
  Towards Large Multimodal Models as Visual Foundation Agents
  ☆113Updated last week
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆215Updated 2 months ago
• web-arena-x / visualwebarena
  VisualWebArena is a benchmark for multimodal agents.
  ☆235Updated last month
• google-deepmind / pix2act
  ☆50Updated 10 months ago
• diagram-of-thought / diagram-of-thought
  Official implementation of paper "On the Diagram of Thought" (https://arxiv.org/abs/2409.10038)
  ☆169Updated last month
• open-compass / GTA
  Official repository for paper "GTA: A Benchmark for General Tool Agents" (NeurIPS 2024 D&B Track)
  ☆43Updated this week
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆46Updated 3 weeks ago
• showlab / Awesome-GUI-Agent
  💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.
  ☆175Updated 2 weeks ago
• camel-ai / crab
  CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆187Updated this week
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆196Updated 3 months ago
• DigiRL-agent / digirl
  Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.
  ☆252Updated last month