This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
☆36Aug 20, 2020Updated 6 years ago
Alternatives and similar repositories for seq2act
Users that are interested in seq2act are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated 2 years ago
- The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…☆54Jan 14, 2022Updated 4 years ago
- A Universal Platform for Training and Evaluation of Mobile Interaction☆64Sep 24, 2025Updated last year
- ☆48Apr 11, 2024Updated 2 years ago
- [ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 e…☆162Jan 3, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of …☆67Jul 27, 2021Updated 5 years ago
- LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation☆70Aug 9, 2024Updated 2 years ago
- A dataset consisting of 502 English dialogs with 12,000 annotated utterances between a user and an assistant discussing movie preferences…☆27Jan 20, 2021Updated 5 years ago
- Swire Dataset and Application Code☆17Jan 7, 2019Updated 7 years ago
- An environment for mobile angets to interact with realistic android device or android emulator☆13Jul 19, 2024Updated 2 years ago
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆33Jul 21, 2025Updated last year
- A curated mobile app design database☆75Sep 27, 2021Updated 5 years ago
- Recognize graphic user interface layout through grouping GUI elements according to their visual attributes☆52Jun 17, 2022Updated 4 years ago
- The dataset includes widget captions that describes UI element's functionalities. It is used for training and evaluation of the widget ca…☆23Jun 24, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- LunarVR is a virtual reality application made for NASA SPACE APPPS CHALLENGE 2018. This project was awarded as Global Winner in Best use …☆12Feb 7, 2023Updated 3 years ago
- ☆26Jun 1, 2026Updated 4 months ago
- CGAT: Channel-aware Graph Attention Networks☆20Mar 24, 2023Updated 3 years ago
- SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation☆65Jul 11, 2025Updated last year
- Overview of Clone Detection Tools for Java☆14Aug 23, 2025Updated last year
- UICrit is a dataset containing human-generated natural language design critiques, corresponding bounding boxes for each critique, and des…☆28Nov 19, 2024Updated last year
- ☆33Sep 27, 2024Updated 2 years ago
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated 2 years ago
- MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding☆79Feb 27, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- RL research on Android devices.☆1,247Updated this week
- Most of the React Native styling material in one page☆14Aug 19, 2016Updated 10 years ago
- Game UI Glitch Detection via Bug Understanding☆12Jul 31, 2021Updated 5 years ago
- 大手子们要是使用过后，能给菜鸡弟弟在Issues反馈个用后体验，那就真的是万分感激了。你一赞，我一赞，年薪百万不停转。☆11Dec 29, 2021Updated 4 years ago
- ☆35Mar 24, 2023Updated 3 years ago
- DroidAgent: Intent-Driven Mobile GUI Testing with Autonomous LLM Agents☆78Mar 12, 2024Updated 2 years ago
- Owl Eyes: Spotting UI Display Issues via Visual Understanding☆12Jul 31, 2020Updated 6 years ago
- AndroidWorld is an environment and benchmark for autonomous agents☆949Oct 5, 2026Updated last week
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆20Oct 29, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆14Sep 22, 2023Updated 3 years ago
- Capstone Project : part of Android Nanodegree program at Udacity☆12Dec 22, 2016Updated 9 years ago
- [SIGIR 2026] "One Adapts to Any: Meta Reward Modeling for Personalized LLM Alignment"☆17Apr 21, 2026Updated 5 months ago
- Combinator Library for writing test generators and test properties for Android Apps☆12Jul 26, 2019Updated 7 years ago
- ☆10Feb 8, 2021Updated 5 years ago
- ☆10Nov 9, 2023Updated 2 years ago
- CoScripter Firefox browser extension☆19Oct 4, 2013Updated 13 years ago