This repository contains the opensource version of the datasets were used for different parts of training and testing of models that ground natural language to UI actions as described in the paper: "Mapping Natural Language Instructions to Mobile UI Action Sequences" by Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge, which is acc…
☆34Aug 20, 2020Updated 5 years ago
Alternatives and similar repositories for seq2act
Users that are interested in seq2act are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Seq2act: Mapping Natural Language Instructions to Mobile UI Action Sequences from Google research☆15Jul 13, 2020Updated 5 years ago
- A Universal Platform for Training and Evaluation of Mobile Interaction☆61Sep 24, 2025Updated 6 months ago
- It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …☆47Aug 2, 2021Updated 4 years ago
- The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of …☆67Jul 27, 2021Updated 4 years ago
- DroidAgent: Intent-Driven Mobile GUI Testing with Autonomous LLM Agents☆66Mar 12, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- AndroidWorld is an environment and benchmark for autonomous agents☆704Mar 25, 2026Updated 2 weeks ago
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆35Jul 21, 2025Updated 8 months ago
- A curated mobile app design database☆67Sep 27, 2021Updated 4 years ago
- SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation☆62Jul 11, 2025Updated 9 months ago
- Graph Convolutional Network on data from Elliptic bitcoin dataset of transactions graph☆16Oct 29, 2019Updated 6 years ago
- Overview of Clone Detection Tools for Java☆14Aug 23, 2025Updated 7 months ago
- UICrit is a dataset containing human-generated natural language design critiques, corresponding bounding boxes for each critique, and des…☆26Nov 19, 2024Updated last year
- LunarVR is a virtual reality application made for NASA SPACE APPPS CHALLENGE 2018. This project was awarded as Global Winner in Best use …☆12Feb 7, 2023Updated 3 years ago
- MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding☆77Feb 27, 2025Updated last year
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- [CVPR 2025] GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration☆20Mar 21, 2025Updated last year
- [ACL'24] WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations☆13Sep 11, 2024Updated last year
- GUIPilot: A Consistency-based Mobile GUI Testing Approach for Detecting Application-specific Bugs☆14Jan 5, 2026Updated 3 months ago
- Owl Eyes: Spotting UI Display Issues via Visual Understanding☆11Jul 31, 2020Updated 5 years ago
- ☆35Mar 24, 2023Updated 3 years ago
- [TIP 2025] Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluation☆11Jul 8, 2023Updated 2 years ago
- [SCIS] MULTI-Benchmark: Multimodal Understanding Leaderboard with Text and Images☆45Nov 19, 2025Updated 4 months ago
- Conv Net for identifying GUI componenets from screenshots using Tensorflow☆12Mar 24, 2023Updated 3 years ago
- This is the official repository of the paper "Atomic-to-Compositional Generalization for Mobile Agents with A New Benchmark and Schedulin…☆13Jul 27, 2025Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆21Oct 29, 2022Updated 3 years ago
- ☆14Sep 22, 2023Updated 2 years ago
- Capstone Project : part of Android Nanodegree program at Udacity☆12Dec 22, 2016Updated 9 years ago
- ☆17Oct 30, 2023Updated 2 years ago
- Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?☆129Feb 20, 2024Updated 2 years ago
- A mobile GUI search engine using a vision-language model☆14May 5, 2025Updated 11 months ago
- A comprehensive list of papers related to Physics-based and Learning-based Differentiable Simulation for Robotics, including papers, code…☆11Apr 7, 2023Updated 3 years ago
- ☆11Nov 2, 2022Updated 3 years ago
- ☆52Jan 24, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆12Aug 8, 2024Updated last year
- A curated list of cutting-edge research papers and resources on Long Chain-of-Thought (CoT) Reasoning with Tools.☆47Dec 17, 2025Updated 3 months ago
- A fast pure-Python search engine☆12Apr 9, 2009Updated 17 years ago
- ☆20Apr 24, 2024Updated last year
- AgileGen: Empowering Agile-Based Generative Software Development through Human-AI Teamwork (accepted by ACM TOSEM)☆18Jan 22, 2025Updated last year
- This project explores the different techniques (both scalable and non scalable) for Graph based semi supervised learning. Recent techniqu…☆14May 28, 2016Updated 9 years ago
- 简介：无需数据库，以《钦定协纪辨方书》为核心的python3 农历、黄历、二十四节气、节假日、星次、每日凶煞、每日值神、建除十二神、每日宜忌、彭祖百忌、每日五行、二十八星宿、天干地支、生辰八字、时辰凶吉等开源项目。背景： 由于三体运动（主要地球、太阳、月球）无法准确预测，目…☆17Mar 12, 2021Updated 5 years ago