Alternatives and similar repositories for seq2act-tensorflow

Users that are interested in seq2act-tensorflow are comparing it to the libraries listed below

• google-research-datasets / seq2act
  This repository contains the opensource version of the datasets were used for different parts of training and testing of models that grou…
  ☆32Updated 5 years ago
• google-research-datasets / uibert
  It includes two datasets that are used in the downstream tasks for evaluating UIBert: App Similar Element Retrieval data and Visual Item …
  ☆46Updated 4 years ago
• X-LANCE / Mobile-Env
  A Universal Platform for Training and Evaluation of Mobile Interaction
  ☆55Updated last month
• google-research-datasets / clay
  The dataset includes UI object type labels (e.g., BUTTON, IMAGE, CHECKBOX) that describes the semantic type of an UI object on Android ap…
  ☆53Updated 3 years ago
• aburns4 / MoTIF
  Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments
  ☆60Updated last year
• google-research-datasets / screen2words
  The dataset includes screen summaries that describes Android app screenshot's functionalities. It is used for training and evaluation of …
  ☆58Updated 4 years ago
• tobyli / Screen2Vec
  Screen2Vec is a new self-supervised technique for generating more comprehensive semantic embeddings of GUI screens and components using t…
  ☆78Updated 8 months ago
• chenjshnn / LabelDroid
  Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning
  ☆48Updated last year
• franklinbill / OwlEye
  Owl Eyes: Spotting UI Display Issues via Visual Understanding
  ☆19Updated 3 years ago
• MobileLLM / AutoDroid
  Source code for the paper "Empowering LLM to use Smartphone for Intelligent Task Automation"
  ☆404Updated last year
• google-research-datasets / rico_semantics
  Consists of ~500k human annotations on the RICO dataset identifying various icons based on their shapes and semantics, and associations b…
  ☆31Updated last year
• X-LANCE / META-GUI-baseline
  [EMNLP 2022] The baseline code for META-GUI dataset
  ☆14Updated last year
• luileito / enrico
  A curated mobile app design database
  ☆63Updated 4 years ago
• cooelf / Auto-GUI
  Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
  ☆253Updated last year
• zzxslp / MM-Navigator
  GPT-4V in Wonderland: LMMs as Smartphone Agents
  ☆135Updated last year
• LlamaTouch / LlamaTouch
  LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation
  ☆64Updated last year
• eric-ai-lab / Screen-Point-and-Read
  Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"
  ☆28Updated last year
• sidongfeng / MUD
  ☆13Updated last year
• ZJU-ACES-ISE / ChatUITest
  Under construction
  ☆13Updated 9 months ago
• lupantech / IconQA
  Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".
  ☆52Updated last year
• shrivastavadisha / repo_level_prompt_generation
  ☆125Updated 2 years ago
• chuyg1005 / seeclick-crawler
  ☆20Updated last year
• MobileLLM / DroidBot-GPT
  Automating Android apps with ChatGPT-like LLM.
  ☆138Updated last year
• zkx06111 / ALGO
  ☆35Updated 2 years ago
• sbunian / VINS
  VINS: Visual Search for Mobile User Interface Design
  ☆46Updated 4 years ago
• xbmxb / CoCo-Agent
  ☆35Updated last year
• ltzheng / Synapse
  [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control
  ☆61Updated 9 months ago
• the-themis-benchmarks / home
  The Themis Benchmark for evaluating automated GUI testing
  ☆154Updated last year
• reddy-lab-code-research / PPOCoder
  Code for the TMLR 2023 paper "PPOCoder: Execution-based Code Generation using Deep Reinforcement Learning"
  ☆117Updated last year
• soumikmohianuta / pixtoapp
  ☆36Updated 6 years ago