Alternatives and similar repositories for assistgui:

Users that are interested in assistgui are comparing it to the libraries listed below

• OpenGVLab / GUI-Odyssey
  GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes fr…
  ☆85Updated 2 months ago
• RUCBM / GUICourse
  GUICourse: From General Vision Langauge Models to Versatile GUI Agents
  ☆96Updated 6 months ago
• njucckevin / SeeClick
  The model, data and code for the visual GUI Agent SeeClick
  ☆294Updated 2 months ago
• showlab / videogui
  [NeurIPS2024] VideoGUI: A Benchmark for GUI Automation from Instructional Videos
  ☆27Updated last month
• YueFan1014 / VideoAgent
  This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)
  ☆163Updated last month
• OSU-NLP-Group / UGround
  UGround: Universal GUI Visual Grounding for GUI Agents
  ☆147Updated this week
• IMNearth / CoAT
  Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)
  ☆69Updated 3 months ago
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆134Updated 5 months ago
• Ziyang412 / VideoTree
  Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"
  ☆92Updated 5 months ago
• IVGSZ / Flash-VStream
  This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"
  ☆153Updated last month
• egoschema / EgoSchema
  ☆84Updated last month
• boheumd / MA-LMM
  (2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
  ☆272Updated 6 months ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆89Updated 6 months ago
• YuxiangChai / AMEX-codebase
  ☆27Updated 4 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆359Updated 2 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆132Updated last year
• dongyh20 / Insight-V
  Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆127Updated last month
• CeeZh / LLoVi
  Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"
  ☆91Updated 3 months ago
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆128Updated 6 months ago
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆249Updated last year
• THUDM / LVBench
  LVBench: An Extreme Long Video Understanding Benchmark
  ☆79Updated 5 months ago
• RenShuhuai-Andy / TimeChat
  [CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding
  ☆327Updated 2 months ago
• RifleZhang / LLaVA-Hound-DPO
  ☆136Updated 3 months ago
• Leon1207 / Video-RAG-master
  This is the official implementation of our paper "Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehension"
  ☆100Updated this week
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• dvlab-research / Prompt-Highlighter
  [CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs
  ☆138Updated 6 months ago
• WebVLN / WebVLN
  Official implementation of WebVLN: Vision-and-Language Navigation on Websites
  ☆27Updated last year
• X-LANCE / Mobile-Env
  A Universal Platform for Training and Evaluation of Mobile Interaction
  ☆41Updated last month
• RupertLuo / Valley
  The official repository of "Video assistant towards large language model makes everything easy"
  ☆217Updated last month
• WHB139426 / Grounded-Video-LLM
  Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
  ☆75Updated last month