boyugou / llava_uground

Related projects ⓘ

Alternatives and complementary repositories for llava_uground

• OSU-NLP-Group / UGround
  Official Repo for UGround
  ☆100Updated 2 weeks ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆227Updated this week
• ranpox / awesome-computer-use
  This is a collection of resources for computer-use agents, including videos, blogs, papers, and projects.
  ☆105Updated 2 weeks ago
• yiye3 / GUICourse
  GUICourse: From General Vision Langauge Models to Versatile GUI Agents
  ☆84Updated 4 months ago
• web-arena-x / visualwebarena
  VisualWebArena is a benchmark for multimodal agents.
  ☆246Updated 2 weeks ago
• OS-Copilot / OS-Atlas
  OS-ATLAS: A Foundation Action Model For Generalist GUI Agents
  ☆173Updated this week
• McGill-NLP / weblinx
  WebLINX is a benchmark for building web navigation agents with conversational capabilities
  ☆118Updated last month
• computer-agents / agent-studio
  Environments, tools, and benchmarks for general computer agents
  ☆172Updated last month
• google-research / android_world
  AndroidWorld is an environment and benchmark for autonomous agents
  ☆137Updated this week
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆140Updated 3 months ago
• showlab / Awesome-GUI-Agent
  💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.
  ☆258Updated this week
• zengxingchen / ChartQA-MLLM
  [IEEE VIS 2024] LLaVA-Chart: Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruc…
  ☆50Updated last month
• THUDM / VisualAgentBench
  Towards Large Multimodal Models as Visual Foundation Agents
  ☆123Updated last week
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆198Updated 4 months ago
• camel-ai / crab
  CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
  ☆192Updated last week
• Yushi-Hu / VisualSketchpad
  Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  ☆124Updated 3 weeks ago
• DigiRL-agent / digirl
  Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.
  ☆265Updated last month
• YuxiangChai / AMEX-codebase
  ☆21Updated last month
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆210Updated last month
• Dongping-Chen / GUI-World
  The Official Code Repository for GUI-World.
  ☆41Updated 3 months ago
• allenai / clin
  ☆78Updated 11 months ago
• THUDM / WebRL
  Building Open LLM Web Agents with Self-Evolving Online Curriculum RL
  ☆213Updated last week
• asappresearch / webagents-step
  ☆38Updated 4 months ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆97Updated last month
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆39Updated last month
• google-deepmind / pix2act
  ☆51Updated 10 months ago
• archiki / ADaPT
  Official code for the paper "ADaPT: As-Needed Decomposition and Planning with Language Models"
  ☆72Updated 10 months ago
• zzxslp / MM-Navigator
  GPT-4V in Wonderland: LMMs as Smartphone Agents
  ☆128Updated 4 months ago
• boyugou / GUI-Agents-Paper-List
  Building a comprehensive and handy list of papers for GUI agents
  ☆34Updated this week
• google-research-datasets / screen_qa
  ScreenQA dataset was introduced in the "ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots" paper. It contains ~86K …
  ☆91Updated 4 months ago