google-deepmind / pix2actLinks
☆59Updated last year
Alternatives and similar repositories for pix2act
Users that are interested in pix2act are comparing it to the libraries listed below
Sorting:
- ☆41Updated last year
- [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control☆60Updated 7 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆142Updated 9 months ago
- Official code for the paper "ADaPT: As-Needed Decomposition and Planning with Language Models"☆87Updated last year
- Repository for the paper Stream of Search: Learning to Search in Language☆150Updated 6 months ago
- ☆84Updated last year
- WebLINX is a benchmark for building web navigation agents with conversational capabilities☆157Updated 6 months ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆61Updated 8 months ago
- ☆61Updated 5 months ago
- A codebase for "Language Models can Solve Computer Tasks"☆234Updated last year
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆54Updated last month
- SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. …☆140Updated last year
- Code for the paper 🌳 Tree Search for Language Model Agents☆212Updated last year
- Multimodal computer agent data collection program☆144Updated last year
- ☆35Updated 2 years ago
- ☆143Updated last year
- DialOp: Decision-oriented dialogue environments for collaborative language agents☆109Updated 9 months ago
- ☆20Updated last year
- WorkArena: How Capable are Web Agents at Solving Common Knowledge Work Tasks?☆201Updated last week
- "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"☆78Updated 4 months ago
- The official implementation of the paper "Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction".☆33Updated last year
- Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents☆126Updated last year
- GPT-4V in Wonderland: LMMs as Smartphone Agents☆134Updated last year
- ☆27Updated last year
- [NeurIPS '23 Spotlight] Thought Cloning: Learning to Think while Acting by Imitating Human Thinking☆270Updated last year
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 7 months ago
- Self-playing Adversarial Language Game Enhances LLM Reasoning, NeurIPS 2024☆137Updated 6 months ago
- WONDERBREAD benchmark + dataset for BPM tasks☆26Updated 3 weeks ago
- Scaling Computer-Use Grounding via UI Decomposition and Synthesis☆102Updated 2 months ago
- Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding☆53Updated 8 months ago