This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
☆35Aug 20, 2020Updated 5 years ago
Alternatives and similar repositories for seq2act
Users that are interested in seq2act are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated last year
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- ☆47Apr 11, 2024Updated 2 years ago
- [ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 e…☆159Jan 3, 2026Updated 6 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Under construction☆13Jan 15, 2025Updated last year
- LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation☆70Aug 9, 2024Updated last year
- Swire Dataset and Application Code☆17Jan 7, 2019Updated 7 years ago
- An environment for mobile angets to interact with realistic android device or android emulator☆13Jul 19, 2024Updated 2 years ago
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆34Jul 21, 2025Updated last year
- A curated mobile app design database☆72Sep 27, 2021Updated 4 years ago
- Recognize graphic user interface layout through grouping GUI elements according to their visual attributes☆50Jun 17, 2022Updated 4 years ago
- LunarVR is a virtual reality application made for NASA SPACE APPPS CHALLENGE 2018. This project was awarded as Global Winner in Best use …☆12Feb 7, 2023Updated 3 years ago
- ☆25Jun 1, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- CGAT: Channel-aware Graph Attention Networks☆20Mar 24, 2023Updated 3 years ago
- Graph Convolutional Network on data from Elliptic bitcoin dataset of transactions graph☆16Oct 29, 2019Updated 6 years ago
- SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation☆64Jul 11, 2025Updated last year
- ☆10May 28, 2024Updated 2 years ago
- UICrit is a dataset containing human-generated natural language design critiques, corresponding bounding boxes for each critique, and des…☆27Nov 19, 2024Updated last year
- ☆33Sep 27, 2024Updated last year
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated last year
- [Archive]☆18Aug 29, 2017Updated 8 years ago
- ☆14Mar 31, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- PsyCare-AI is an AI-powered mental health prediction project, offering a user-friendly interface to predict potential mental health issue…☆10Jul 19, 2023Updated 3 years ago
- MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding☆78Feb 27, 2025Updated last year
- Using OpenCV to create an AR extension for PyGame☆11May 17, 2019Updated 7 years ago
- ☆24Aug 29, 2023Updated 2 years ago
- RL research on Android devices.☆1,232Updated this week
- 《A fast and elitist multi-objective genetic algorithm: NSGA-II》☆23Mar 6, 2023Updated 3 years ago
- A mobile GUI search engine using a vision-language model☆15May 5, 2025Updated last year
- 大手子们要是使用过后，能给菜鸡弟弟在Issues反馈个用后体验，那就真的是万分感激了。你一赞，我一赞，年薪百万不停转。☆11Dec 29, 2021Updated 4 years ago
- ☆35Mar 24, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- DroidAgent: Intent-Driven Mobile GUI Testing with Autonomous LLM Agents☆71Mar 12, 2024Updated 2 years ago
- Owl Eyes: Spotting UI Display Issues via Visual Understanding☆12Jul 31, 2020Updated 5 years ago
- YouTube Q&A Chatbot using semantic search, large language models and Rest API.☆12Mar 15, 2025Updated last year
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆20Oct 29, 2022Updated 3 years ago
- ☆14Sep 22, 2023Updated 2 years ago
- This is the official repository of the paper "Atomic-to-Compositional Generalization for Mobile Agents with A New Benchmark and Schedulin…☆14Jul 27, 2025Updated 11 months ago
- Capstone Project : part of Android Nanodegree program at Udacity☆12Dec 22, 2016Updated 9 years ago