eric-ai-lab / Screen-Point-and-ReadLinks
Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"
☆28Updated last year
Alternatives and similar repositories for Screen-Point-and-Read
Users that are interested in Screen-Point-and-Read are comparing it to the libraries listed below
Sorting:
- [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents☆46Updated 6 months ago
- Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"☆58Updated 10 months ago
- ZeroGUI: Automating Online GUI Learning at Zero Human Cost☆84Updated last month
- Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding☆53Updated 8 months ago
- [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.☆73Updated 9 months ago
- [NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos☆44Updated 2 months ago
- This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"☆16Updated 3 weeks ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆43Updated last year
- (ICLR 2025) The Official Code Repository for GUI-World.☆65Updated 8 months ago
- [EMNLP 2025] Distill Visual Chart Reasoning Ability from LLMs to MLLMs☆54Updated last week
- MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment☆35Updated last year
- Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs☆89Updated 10 months ago
- ☆31Updated 11 months ago
- Official implementation of "PyVision: Agentic Vision with Dynamic Tooling."☆122Updated last month
- ☆91Updated last month
- Official repository for "Web-Shepherd: Advancing PRMs for Reinforcing Web Agents"☆42Updated 3 months ago
- GUICourse: From General Vision Langauge Models to Versatile GUI Agents☆127Updated last year
- An Easy-to-use Hallucination Detection Framework for LLMs.☆61Updated last year
- ☆74Updated last year
- Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models☆40Updated 2 weeks ago
- [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision☆69Updated last year
- ☆62Updated 6 months ago
- The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"☆27Updated 3 months ago
- Reinforcement Learning of Vision Language Models with Self Visual Perception Reward☆62Updated this week
- ☆36Updated last year
- [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control☆60Updated 7 months ago
- [IEEE VIS 2024] LLaVA-Chart: Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruc…☆70Updated 7 months ago
- Code for the paper "AutoPresent: Designing Structured Visuals From Scratch" (CVPR 2025)☆120Updated 3 months ago
- Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"☆36Updated last year
- Multimodal RewardBench☆46Updated 6 months ago