MobileLLM / AutoDroid
Source code for the paper "Empowering LLM to use Smartphone for Intelligent Task Automation"
☆341Updated last year
Alternatives and similar repositories for AutoDroid:
Users that are interested in AutoDroid are comparing it to the libraries listed below
- Automating Android apps with ChatGPT-like LLM.☆120Updated last year
- Paper list for Personal LLM Agents☆378Updated 11 months ago
- LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation☆56Updated 8 months ago
- AndroidWorld is an environment and benchmark for autonomous agents☆264Updated this week
- The model, data and code for the visual GUI Agent SeeClick☆357Updated 4 months ago
- ☆210Updated 2 weeks ago
- Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)☆231Updated 8 months ago
- GitHub page for "Large Language Model-Brained GUI Agents: A Survey"☆142Updated 2 weeks ago
- ☆36Updated last year
- GPT-4V in Wonderland: LMMs as Smartphone Agents☆134Updated 8 months ago
- Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction☆275Updated last month
- Towards Large Multimodal Models as Visual Foundation Agents☆202Updated 2 months ago
- DroidAgent: Intent-Driven Mobile GUI Testing with Autonomous LLM Agents☆25Updated last year
- Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)☆82Updated 5 months ago
- VisionTasker introduces a novel two-stage framework combining vision-based UI understanding and LLM task planning for mobile task automat…☆65Updated last month
- Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.☆347Updated last month
- Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"☆335Updated last week
- GUI Grounding for Professional High-Resolution Computer Use☆172Updated last month
- Building a comprehensive and handy list of papers for GUI agents☆282Updated last month
- VisualWebArena is a benchmark for multimodal agents.☆332Updated 5 months ago
- A Universal Platform for Training and Evaluation of Mobile Interaction☆44Updated last month
- OS-ATLAS: A Foundation Action Model For Generalist GUI Agents☆317Updated last month
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆60Updated 7 months ago
- 💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.☆619Updated last month
- A Stream-based LLM Agent Framework for Continuous Context Sensing and Sharing☆35Updated 4 months ago
- Consists of ~500k human annotations on the RICO dataset identifying various icons based on their shapes and semantics, and associations b…☆28Updated 9 months ago
- ScreenAgent: A Computer Control Agent Driven by Visual Language Large Model (IJCAI-24)☆430Updated 4 months ago
- GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…☆101Updated 5 months ago
- Official implementation of AppAgentX: Evolving GUI Agents as Proficient Smartphone Users☆306Updated last month
- [NeurIPS'23 Spotlight] "Mind2Web: Towards a Generalist Agent for the Web"☆813Updated last week