This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
☆36Aug 20, 2020Updated 6 years ago
Alternatives and similar repositories for seq2act
Users that are interested in seq2act are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated 2 years ago
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆48Aug 2, 2021Updated 5 years ago
- LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation☆70Aug 9, 2024Updated 2 years ago
- ☆21Jul 26, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- UICrit is a dataset containing human-generated natural language design critiques, corresponding bounding boxes for each critique, and des…☆28Nov 19, 2024Updated last year
- A curated mobile app design database☆77Sep 27, 2021Updated 5 years ago
- A dataset consisting of 502 English dialogs with 12,000 annotated utterances between a user and an assistant discussing movie preferences…☆27Jan 20, 2021Updated 5 years ago
- Swire Dataset and Application Code☆17Jan 7, 2019Updated 7 years ago
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆33Jul 21, 2025Updated last year
- This repository holds the data and code for the AndroR2 dataset of manually-reproduced bug reports for Android apps☆28Jun 11, 2021Updated 5 years ago
- An environment for mobile angets to interact with realistic android device or android emulator☆13Jul 19, 2024Updated 2 years ago
- The model, data and code for the visual GUI Agent SeeClick☆496Jul 13, 2025Updated last year
- ☆52Jan 24, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A suite a micro-benchmarks to stress the Golo runtime and compilation result.☆12Jan 21, 2019Updated 7 years ago
- Recognize graphic user interface layout through grouping GUI elements according to their visual attributes☆52Jun 17, 2022Updated 4 years ago
- [KDD2026] The repo contains the code for "GUI-Robust: A Comprehensive Dataset for Testing GUI Agent Robustness in Real-World Anomalies"☆13Dec 30, 2025Updated 10 months ago
- CGAT: Channel-aware Graph Attention Networks☆20Mar 24, 2023Updated 3 years ago
- Graph Convolutional Network on data from Elliptic bitcoin dataset of transactions graph☆16Oct 29, 2019Updated 7 years ago
- Checks tutorials using an Anthropic Skill☆13Oct 28, 2025Updated last year
- LunarVR is a virtual reality application made for NASA SPACE APPPS CHALLENGE 2018. This project was awarded as Global Winner in Best use …☆12Feb 7, 2023Updated 3 years ago
- Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?☆128Feb 20, 2024Updated 2 years ago
- Overview of Clone Detection Tools for Java☆14Aug 23, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆22Feb 25, 2023Updated 3 years ago
- ☆14Mar 31, 2022Updated 4 years ago
- ☆329Aug 18, 2025Updated last year
- ☆33Sep 27, 2024Updated 2 years ago
- UI Display Defects Mocker Tool☆10Jan 29, 2026Updated 9 months ago
- ☆14Aug 14, 2023Updated 3 years ago
- ☆24Aug 29, 2023Updated 3 years ago
- A comprehensive list of papers related to Physics-based and Learning-based Differentiable Simulation for Robotics, including papers, code…☆11Apr 7, 2023Updated 3 years ago
- ☆20May 9, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GUICourse: From General Vision Langauge Models to Versatile GUI Agents☆144Mar 1, 2026Updated 8 months ago
- Conv Net for identifying GUI componenets from screenshots using Tensorflow☆12Mar 24, 2023Updated 3 years ago
- This is the project repo for open-source AR2-D2: Training a Robot Without a Robot [CoRL 2023]☆12Jul 7, 2024Updated 2 years ago
- VINS: Visual Search for Mobile User Interface Design☆54Jan 9, 2021Updated 5 years ago
- ☆47Dec 20, 2020Updated 5 years ago
- Game UI Glitch Detection via Bug Understanding☆12Jul 31, 2021Updated 5 years ago
- Explore Android apps like human.☆135Feb 18, 2023Updated 3 years ago