This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
☆36Aug 20, 2020Updated 5 years ago
Alternatives and similar repositories for seq2act
Users that are interested in seq2act are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 6 years ago
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments☆61Aug 19, 2024Updated last year
- [ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 e…☆159Jan 3, 2026Updated 7 months ago
- Under construction☆14Jan 15, 2025Updated last year
- The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of …☆67Jul 27, 2021Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation☆70Aug 9, 2024Updated 2 years ago
- Swire Dataset and Application Code☆17Jan 7, 2019Updated 7 years ago
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆34Jul 21, 2025Updated last year
- A curated mobile app design database☆73Sep 27, 2021Updated 4 years ago
- ☆26Jun 1, 2026Updated 2 months ago
- CGAT: Channel-aware Graph Attention Networks☆20Mar 24, 2023Updated 3 years ago
- Graph Convolutional Network on data from Elliptic bitcoin dataset of transactions graph☆16Oct 29, 2019Updated 6 years ago
- SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation☆65Jul 11, 2025Updated last year
- Overview of Clone Detection Tools for Java☆14Aug 23, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- UICrit is a dataset containing human-generated natural language design critiques, corresponding bounding boxes for each critique, and des…☆28Nov 19, 2024Updated last year
- ☆33Sep 27, 2024Updated last year
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated last year
- MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding☆78Feb 27, 2025Updated last year
- ☆24Aug 29, 2023Updated 2 years ago
- RL research on Android devices.☆1,238Jul 31, 2026Updated last week
- Most of the React Native styling material in one page☆14Aug 19, 2016Updated 9 years ago
- Game UI Glitch Detection via Bug Understanding☆12Jul 31, 2021Updated 5 years ago
- ☆35Mar 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- DroidAgent: Intent-Driven Mobile GUI Testing with Autonomous LLM Agents☆72Mar 12, 2024Updated 2 years ago
- AndroidWorld is an environment and benchmark for autonomous agents☆845Jul 16, 2026Updated 3 weeks ago
- Owl Eyes: Spotting UI Display Issues via Visual Understanding☆12Jul 31, 2020Updated 6 years ago
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆20Oct 29, 2022Updated 3 years ago
- This is the official repository of the paper "Atomic-to-Compositional Generalization for Mobile Agents with A New Benchmark and Schedulin…☆15Jul 27, 2025Updated last year
- ☆14Sep 22, 2023Updated 2 years ago
- [TIP 2025] Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluation☆12Jul 8, 2023Updated 3 years ago
- Conv Net for identifying GUI componenets from screenshots using Tensorflow☆12Mar 24, 2023Updated 3 years ago
- Combinator Library for writing test generators and test properties for Android Apps☆12Jul 26, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Бенчмарк для оценки способности языковых моделей решать математические и физические задачи на русском языке☆22Nov 14, 2025Updated 8 months ago
- ☆10Nov 9, 2023Updated 2 years ago
- Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?☆128Feb 20, 2024Updated 2 years ago
- ☆11Oct 17, 2024Updated last year
- Explore Android apps like human.☆135Feb 18, 2023Updated 3 years ago
- This project is a versatile and powerful search tool that leverages state-of-the-art natural language processing models to provide releva…☆12Apr 3, 2023Updated 3 years ago
- It is deep recommendation model with attribute-level co-attention, which has been accepted as a short paper in SIGIR2020.☆10Aug 13, 2020Updated 5 years ago