This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
☆36Aug 20, 2020Updated 6 years ago
Alternatives and similar repositories for seq2act
Users that are interested in seq2act are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated 2 years ago
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- A Universal Platform for Training and Evaluation of Mobile Interaction☆64Sep 24, 2025Updated 11 months ago
- ☆48Apr 11, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 e…☆162Jan 3, 2026Updated 8 months ago
- Under construction☆14Jan 15, 2025Updated last year
- The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of …☆67Jul 27, 2021Updated 5 years ago
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆48Aug 2, 2021Updated 5 years ago
- LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation☆70Aug 9, 2024Updated 2 years ago
- Recognize graphic user interface layout through grouping GUI elements according to their visual attributes☆51Jun 17, 2022Updated 4 years ago
- A suite a micro-benchmarks to stress the Golo runtime and compilation result.☆12Jan 21, 2019Updated 7 years ago
- Graph Convolutional Network on data from Elliptic bitcoin dataset of transactions graph☆16Oct 29, 2019Updated 6 years ago
- ☆10May 28, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆33Sep 27, 2024Updated last year
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated 2 years ago
- A Project that uses Zillow research data on Quandl, Prophet for time series forecasting, Altair for vega-lite charts and Folium for an cr…☆12Dec 8, 2022Updated 3 years ago
- PsyCare-AI is an AI-powered mental health prediction project, offering a user-friendly interface to predict potential mental health issue…☆10Jul 19, 2023Updated 3 years ago
- MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding☆78Feb 27, 2025Updated last year
- ☆24Aug 29, 2023Updated 3 years ago
- RL research on Android devices.☆1,243Sep 9, 2026Updated last week
- Most of the React Native styling material in one page☆14Aug 19, 2016Updated 10 years ago
- 《A fast and elitist multi-objective genetic algorithm: NSGA-II》☆24Mar 6, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Game UI Glitch Detection via Bug Understanding☆12Jul 31, 2021Updated 5 years ago
- ☆35Mar 24, 2023Updated 3 years ago
- DroidAgent: Intent-Driven Mobile GUI Testing with Autonomous LLM Agents☆76Mar 12, 2024Updated 2 years ago
- Owl Eyes: Spotting UI Display Issues via Visual Understanding☆12Jul 31, 2020Updated 6 years ago
- ☆12Aug 24, 2023Updated 3 years ago
- AndroidWorld is an environment and benchmark for autonomous agents☆927Sep 9, 2026Updated last week
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆20Oct 29, 2022Updated 3 years ago
- ☆14Sep 22, 2023Updated 3 years ago
- [TIP 2025] Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluation☆12Jul 8, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Conv Net for identifying GUI componenets from screenshots using Tensorflow☆12Mar 24, 2023Updated 3 years ago
- Capstone Project : part of Android Nanodegree program at Udacity☆12Dec 22, 2016Updated 9 years ago
- Combinator Library for writing test generators and test properties for Android Apps☆12Jul 26, 2019Updated 7 years ago
- ☆10Nov 9, 2023Updated 2 years ago
- CoScripter Firefox browser extension☆19Oct 4, 2013Updated 12 years ago
- ☆11Mar 24, 2023Updated 3 years ago
- Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?☆128Feb 20, 2024Updated 2 years ago