This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
☆34Aug 20, 2020Updated 5 years ago
Alternatives and similar repositories for seq2act
Users that are interested in seq2act are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- A Universal Platform for Training and Evaluation of Mobile Interaction☆61Sep 24, 2025Updated 7 months ago
- ☆46Apr 11, 2024Updated 2 years ago
- [ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 e…☆156Jan 3, 2026Updated 3 months ago
- Under construction☆13Jan 15, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆47Aug 2, 2021Updated 4 years ago
- LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation☆67Aug 9, 2024Updated last year
- A dataset consisting of 502 English dialogs with 12,000 annotated utterances between a user and an assistant discussing movie preferences…☆28Jan 20, 2021Updated 5 years ago
- Swire Dataset and Application Code☆17Jan 7, 2019Updated 7 years ago
- DroidAgent: Intent-Driven Mobile GUI Testing with Autonomous LLM Agents☆68Mar 12, 2024Updated 2 years ago
- The dataset includes widget captions that describes UI element's functionalities. It is used for training and evaluation of the widget ca…☆23Jun 24, 2021Updated 4 years ago
- A suite a micro-benchmarks to stress the Golo runtime and compilation result.☆12Jan 21, 2019Updated 7 years ago
- Overview of Clone Detection Tools for Java☆14Aug 23, 2025Updated 8 months ago
- UICrit is a dataset containing human-generated natural language design critiques, corresponding bounding boxes for each critique, and des…☆26Nov 19, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆32Sep 27, 2024Updated last year
- MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding☆78Feb 27, 2025Updated last year
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated last year
- A Project that uses Zillow research data on Quandl, Prophet for time series forecasting, Altair for vega-lite charts and Folium for an cr…☆12Dec 8, 2022Updated 3 years ago
- Game UI Glitch Detection via Bug Understanding☆12Jul 31, 2021Updated 4 years ago
- ☆14Mar 31, 2022Updated 4 years ago
- Most of the React Native styling material in one page☆14Aug 19, 2016Updated 9 years ago
- Using OpenCV to create an AR extension for PyGame☆11May 17, 2019Updated 6 years ago
- GUIPilot: A Consistency-based Mobile GUI Testing Approach for Detecting Application-specific Bugs☆14Apr 22, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Owl Eyes: Spotting UI Display Issues via Visual Understanding☆12Jul 31, 2020Updated 5 years ago
- ☆12Aug 24, 2023Updated 2 years ago
- ☆35Mar 24, 2023Updated 3 years ago
- [TIP 2025] Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluation☆11Jul 8, 2023Updated 2 years ago
- Conv Net for identifying GUI componenets from screenshots using Tensorflow☆12Mar 24, 2023Updated 3 years ago
- ☆10Nov 9, 2023Updated 2 years ago
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆20Oct 29, 2022Updated 3 years ago
- A python library for the YDLidar X2☆11Sep 22, 2021Updated 4 years ago
- Capstone Project : part of Android Nanodegree program at Udacity☆12Dec 22, 2016Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Бенчмарк для оценки способности языковых моделей решать математические и физические задачи на русском языке☆22Nov 14, 2025Updated 5 months ago
- ☆17Oct 30, 2023Updated 2 years ago
- ☆11Oct 17, 2024Updated last year
- A mobile GUI search engine using a vision-language model☆14May 5, 2025Updated 11 months ago
- ☆11Nov 2, 2022Updated 3 years ago
- ☆53Jan 24, 2024Updated 2 years ago
- ☆18Feb 21, 2022Updated 4 years ago