🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
☆403Feb 20, 2026Updated 2 weeks ago
Alternatives and similar repositories for crab
Users that are interested in crab are comparing it to the libraries listed below
Sorting:
- 🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org☆16,172Updated this week
- 🤝 The code for "Can Large Language Model Agents Simulate Human Trust Behaviors?"☆112Apr 6, 2025Updated 11 months ago
- 🏝️ OASIS: Open Agent Social Interaction Simulations with One Million Agents.☆2,510Feb 20, 2026Updated 2 weeks ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆148Nov 26, 2024Updated last year
- An open-source framework for collaborative AI agents, enabling diverse, distributed agents to team up and tackle complex tasks through in…☆803Oct 4, 2025Updated 5 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Apr 9, 2025Updated 10 months ago
- 🦉 OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation☆19,129Feb 27, 2026Updated last week
- 🐉 Loong: Synthesize Long CoTs at Scale through Verifiers.☆487Updated this week
- WebLINX is a benchmark for building web navigation agents with conversational capabilities☆160Feb 11, 2025Updated last year
- A toolkit for building computer use AI agents☆183Jun 26, 2025Updated 8 months ago
- OpenResearcher, an advanced Scientific Research Assistant☆497Oct 10, 2024Updated last year
- [ICML'24] SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large mult…☆826Feb 3, 2025Updated last year
- A Framework for Evaluating AI Agent Safety in Realistic Environments☆30Oct 2, 2025Updated 5 months ago
- [ICLR 2025] Automated Design of Agentic Systems☆1,522Jan 28, 2025Updated last year
- [ICLR 2025] A trinity of environments, tools, and benchmarks for general virtual agents☆228Jun 16, 2025Updated 8 months ago
- Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups☆51Dec 23, 2024Updated last year
- A lightweight framework for building LLM-based agents☆2,228Jan 26, 2026Updated last month
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆473Mar 19, 2024Updated last year
- Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"☆64Oct 19, 2024Updated last year
- Chat Markup Language conversation library☆55Jan 3, 2024Updated 2 years ago
- ☆171Jan 25, 2024Updated 2 years ago
- 🐝 The First Self-Improving Agentic Solution☆989Feb 5, 2026Updated last month
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Jun 3, 2024Updated last year
- [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments☆2,608Updated this week
- The Library for LLM-based multi-agent applications☆102Jul 18, 2025Updated 7 months ago
- ☆67Mar 30, 2025Updated 11 months ago
- E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to any LLM for secure computer use.☆1,263Updated this week
- 🤖 A list of latest AGI-related repos, resources and courses including LLMs and AI Agents.☆13Sep 24, 2024Updated last year
- [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents☆48Feb 27, 2025Updated last year
- Code for the paper 🌳 Tree Search for Language Model Agents☆220Jul 25, 2024Updated last year
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,333Oct 30, 2025Updated 4 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆2,010Dec 22, 2024Updated last year
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆106Mar 14, 2024Updated last year
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆241May 5, 2024Updated last year
- This repository `II-Commons` contains tools for managing text and image datasets, including loading, fetching, and embedding large datase…☆33Jul 22, 2025Updated 7 months ago
- [FORGE 2025] Incorporating Agile methodology into agents to create complex real-world softwares☆450Oct 15, 2024Updated last year
- An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents☆5,876Sep 26, 2024Updated last year
- An autoagentic AGI that is self-evolving and modular.☆961Sep 4, 2024Updated last year
- An example of multi-agent orchestration with llama-index☆446Jan 23, 2025Updated last year