Alternatives and similar repositories for AUI

Users that are interested in AUI are comparing it to the libraries listed below

• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆47Updated 10 months ago
• showlab / VideoGUI
  [NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos
  ☆48Updated 6 months ago
• JoeLeelyf / Skyra
  Skyra: AI-Generated Video Detection via Grounded Artifact Reasoning
  ☆28Updated 2 weeks ago
• OpenGVLab / ZeroGUI
  ZeroGUI: Automating Online GUI Learning at Zero Human Cost
  ☆104Updated 5 months ago
• apple / ml-mia-bench
  This repo contains code and data for ICLR 2025 paper MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
  ☆36Updated 10 months ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆98Updated last year
• showlab / VisInContext
  Official implementation of Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning
  ☆28Updated last year
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆73Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆62Updated last year
• facebookresearch / multimodal_rewardbench
  Multimodal RewardBench
  ☆58Updated 10 months ago
• Yushi-Hu / VisualSketchpad
  Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  ☆275Updated 5 months ago
• Dongping-Chen / GUI-World
  (ICLR 2025) The Official Code Repository for GUI-World.
  ☆66Updated last year
• McGill-NLP / AURORA
  Code and data for the paper: Learning Action and Reasoning-Centric Image Editing from Videos and Simulation
  ☆33Updated 6 months ago
• JiuTian-VL / Optimus-1
  [NeurIPS 2024] Official Implementation for Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks
  ☆91Updated 6 months ago
• eric-ai-lab / Screen-Point-and-Read
  Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"
  ☆28Updated last year
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated 2 years ago
• NOVAglow646 / Monet
  Official codes of "Monet: Reasoning in Latent Visual Space Beyond Image and Language"
  ☆108Updated last week
• agents-x-project / PyVision
  [MTI-LLM@NeurIPS 2025] Official implementation of "PyVision: Agentic Vision with Dynamic Tooling."
  ☆143Updated 5 months ago
• showlab / WorldGUI
  Enable AI to control your PC. This repo includes the WorldGUI Benchmark and GUI-Thinker Agent Framework.
  ☆104Updated 5 months ago
• SalesforceAIResearch / LATTE
  ☆68Updated 3 months ago
• bigai-nlco / VideoLLaMB
  [ICCV 2025] Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
  ☆80Updated 10 months ago
• yunfeixie233 / ViGaL
  ☆64Updated 2 months ago
• TencentARC / SEED-Bench-R1
  ☆96Updated 6 months ago
• EvolvingLMMs-Lab / VideoMMMU
  ☆62Updated 4 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆42Updated 3 weeks ago
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆126Updated 5 months ago
• ASTRAL-Group / AlphaOne
  [EMNLP 2025 Main] AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time
  ☆89Updated 7 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆72Updated last year
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆53Updated last year
• para-lost / AutoPresent
  Code for the paper "AutoPresent: Designing Structured Visuals From Scratch" (CVPR 2025)
  ☆146Updated 7 months ago