π¦οΈ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
β408Mar 20, 2026Updated last week
Alternatives and similar repositories for crab
Users that are interested in crab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- π« CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.orgβ16,479Updated this week
- π€ The code for "Can Large Language Model Agents Simulate Human Trust Behaviors?"β115Apr 6, 2025Updated 11 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]β148Nov 26, 2024Updated last year
- WebLINX is a benchmark for building web navigation agents with conversational capabilitiesβ161Feb 11, 2025Updated last year
- ποΈ OASIS: Open Agent Social Interaction Simulations with One Million Agents.β3,845Mar 20, 2026Updated last week
- NordVPN Threat Protection Proβ’ β’ AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- π¦ OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationβ19,217Mar 18, 2026Updated last week
- π Loong: Synthesize Long CoTs at Scale through Verifiers.β496Mar 20, 2026Updated last week
- An open-source framework for collaborative AI agents, enabling diverse, distributed agents to team up and tackle complex tasks through inβ¦β811Oct 4, 2025Updated 5 months ago
- A Framework for Evaluating AI Agent Safety in Realistic Environmentsβ30Oct 2, 2025Updated 5 months ago
- [ICML'24] SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large multβ¦β839Feb 3, 2025Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Modelsβ118Apr 9, 2025Updated 11 months ago
- A toolkit for building computer use AI agentsβ192Jun 26, 2025Updated 9 months ago
- CAMEL framework-based multi-agent system for task-driven and dynamic environmentsβ109May 21, 2024Updated last year
- OpenResearcher, an advanced Scientific Research Assistantβ498Oct 10, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean β’ AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An autoagentic AGI that is self-evolving and modular.β962Sep 4, 2024Updated last year
- Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-upsβ51Dec 23, 2024Updated last year
- Code for the paper π³ Tree Search for Language Model Agentsβ221Jul 25, 2024Updated last year
- [ICLR 2025] Automated Design of Agentic Systemsβ1,540Jan 28, 2025Updated last year
- [ICLR 2025] A trinity of environments, tools, and benchmarks for general virtual agentsβ231Jun 16, 2025Updated 9 months ago
- [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentsβ2,689Mar 17, 2026Updated last week
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"β475Mar 19, 2024Updated 2 years ago
- An open-source toolkit helping developers build natural language database query solutionsβ26May 5, 2025Updated 10 months ago
- E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to any LLM for secure computer use.β1,321Updated this week
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"β70Dec 9, 2024Updated last year
- An agent orchestration framework for economic agentsβ112Aug 12, 2025Updated 7 months ago
- The Library for LLM-based multi-agent applicationsβ102Jul 18, 2025Updated 8 months ago
- The model, data and code for the visual GUI Agent SeeClickβ475Jul 13, 2025Updated 8 months ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.β20Jun 3, 2024Updated last year
- Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"β65Oct 19, 2024Updated last year
- Agentlessπ±: an agentless approach to automatically solve software development problemsβ2,025Dec 22, 2024Updated last year
- GUICourse: From General Vision Langauge Models to Versatile GUI Agentsβ137Mar 1, 2026Updated 3 weeks ago
- An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agentsβ5,887Sep 26, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including Cβ¦β5,395Mar 19, 2026Updated last week
- π The First Self-Improving Agentic Solutionβ1,015Feb 5, 2026Updated last month
- A lightweight framework for building LLM-based agentsβ2,234Updated this week
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898β243May 5, 2024Updated last year
- (ICLR 2025) The Official Code Repository for GUI-World.β68Dec 18, 2024Updated last year
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chainβ106Mar 14, 2024Updated 2 years ago
- β171Jan 25, 2024Updated 2 years ago