This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
☆34Aug 20, 2020Updated 5 years ago
Alternatives and similar repositories for seq2act
Users that are interested in seq2act are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated last year
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- ☆47Apr 11, 2024Updated 2 years ago
- [ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 e…☆159Jan 3, 2026Updated 5 months ago
- Under construction☆13Jan 15, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆48Aug 2, 2021Updated 4 years ago
- A dataset consisting of 502 English dialogs with 12,000 annotated utterances between a user and an assistant discussing movie preferences…☆28Jan 20, 2021Updated 5 years ago
- AndroidWorld is an environment and benchmark for autonomous agents☆809Jun 12, 2026Updated 2 weeks ago
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆35Jul 21, 2025Updated 11 months ago
- Recognize graphic user interface layout through grouping GUI elements according to their visual attributes☆50Jun 17, 2022Updated 4 years ago
- The dataset includes widget captions that describes UI element's functionalities. It is used for training and evaluation of the widget ca…☆23Jun 24, 2021Updated 5 years ago
- A suite a micro-benchmarks to stress the Golo runtime and compilation result.☆12Jan 21, 2019Updated 7 years ago
- SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation☆64Jul 11, 2025Updated 11 months ago
- ☆33Sep 27, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆10May 28, 2024Updated 2 years ago
- MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding☆79Feb 27, 2025Updated last year
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated last year
- [CVPR 2025] GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration☆21Mar 21, 2025Updated last year
- A Project that uses Zillow research data on Quandl, Prophet for time series forecasting, Altair for vega-lite charts and Folium for an cr…☆12Dec 8, 2022Updated 3 years ago
- ☆14Mar 31, 2022Updated 4 years ago
- RL research on Android devices.☆1,227Updated this week
- [Archive]☆18Aug 29, 2017Updated 8 years ago
- Using OpenCV to create an AR extension for PyGame☆11May 17, 2019Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- GUIPilot: A Consistency-based Mobile GUI Testing Approach for Detecting Application-specific Bugs☆15Apr 22, 2026Updated 2 months ago
- ☆12Aug 24, 2023Updated 2 years ago
- [TIP 2025] Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluation☆12Jul 8, 2023Updated 2 years ago
- ☆10Nov 9, 2023Updated 2 years ago
- This is the official repository of the paper "Atomic-to-Compositional Generalization for Mobile Agents with A New Benchmark and Schedulin…☆14Jul 27, 2025Updated 11 months ago
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆20Oct 29, 2022Updated 3 years ago
- ☆14Sep 22, 2023Updated 2 years ago
- Бенчмарк для оценки способности языковых моделей решать математиче ские и физические задачи на русском языке☆22Nov 14, 2025Updated 7 months ago
- Explore Android apps like human.☆134Feb 18, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆11Oct 17, 2024Updated last year
- ☆17Oct 30, 2023Updated 2 years ago
- CoScripter Firefox browser extension☆19Oct 4, 2013Updated 12 years ago
- ☆11Mar 24, 2023Updated 3 years ago
- ☆11Nov 2, 2022Updated 3 years ago
- ☆53Jan 24, 2024Updated 2 years ago
- ☆18Feb 21, 2022Updated 4 years ago