This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
☆34Aug 20, 2020Updated 5 years ago
Alternatives and similar repositories for seq2act
Users that are interested in seq2act are comparing it to the libraries listed below
Sorting:
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 5 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated last year
- ☆45Apr 11, 2024Updated last year
- [ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 e…☆149Jan 3, 2026Updated 2 months ago
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆47Aug 2, 2021Updated 4 years ago
- The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of …☆65Jul 27, 2021Updated 4 years ago
- LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation☆67Aug 9, 2024Updated last year
- Swire Dataset and Application Code☆17Jan 7, 2019Updated 7 years ago
- AndroidWorld is an environment and benchmark for autonomous agents☆670Mar 13, 2026Updated last week
- An environment for mobile angets to interact with realistic android device or android emulator☆13Jul 19, 2024Updated last year
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆35Jul 21, 2025Updated 8 months ago
- A curated mobile app design database☆67Sep 27, 2021Updated 4 years ago
- Recognize graphic user interface layout through grouping GUI elements according to their visual attributes☆49Jun 17, 2022Updated 3 years ago
- The dataset includes widget captions that describes UI element's functionalities. It is used for training and evaluation of the widget ca…☆23Jun 24, 2021Updated 4 years ago
- A suite a micro-benchmarks to stress the Golo runtime and compilation result.☆12Jan 21, 2019Updated 7 years ago
- SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation☆61Jul 11, 2025Updated 8 months ago
- Overview of Clone Detection Tools for Java☆14Aug 23, 2025Updated 6 months ago
- UICrit is a dataset containing human-generated natural language design critiques, corresponding bounding boxes for each critique, and des…☆26Nov 19, 2024Updated last year
- ☆31Sep 27, 2024Updated last year
- ☆10May 28, 2024Updated last year
- MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding☆77Feb 27, 2025Updated last year
- [CVPR 2025] GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration☆20Mar 21, 2025Updated last year
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated last year
- A Project that uses Zillow research data on Quandl, Prophet for time series forecasting, Altair for vega-lite charts and Folium for an cr…☆12Dec 8, 2022Updated 3 years ago
- ☆14Mar 31, 2022Updated 3 years ago
- RL research on Android devices.☆1,196Feb 26, 2026Updated 3 weeks ago
- ☆23Aug 29, 2023Updated 2 years ago
- Most of the React Native styling material in one page☆14Aug 19, 2016Updated 9 years ago
- Using OpenCV to create an AR extension for PyGame☆11May 17, 2019Updated 6 years ago
- ☆12Aug 24, 2023Updated 2 years ago
- ☆35Mar 24, 2023Updated 2 years ago
- [TIP 2025] Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluation☆10Jul 8, 2023Updated 2 years ago
- ☆10Nov 9, 2023Updated 2 years ago
- This is the official repository of the paper "Atomic-to-Compositional Generalization for Mobile Agents with A New Benchmark and Schedulin…☆13Jul 27, 2025Updated 7 months ago
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆21Oct 29, 2022Updated 3 years ago
- A python library for the YDLidar X2☆11Sep 22, 2021Updated 4 years ago
- ☆14Sep 22, 2023Updated 2 years ago
- Capstone Project : part of Android Nanodegree program at Udacity☆12Dec 22, 2016Updated 9 years ago
- ☆10Feb 8, 2021Updated 5 years ago