Harness for running and evaluating AI agents against RL environments
☆224Jul 28, 2026Updated this week
Alternatives and similar repositories for archipelago
Users that are interested in archipelago are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jun 19, 2026Updated last month
- ☆81Jun 25, 2026Updated last month
- Framework for evaluating and improving agents☆3,611Updated this week
- 💻 SETA: Scaling Environments for Terminal Agents☆128Updated this week
- Trajectory Recording and Capture Environments☆19Jan 24, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆441Updated this week
- Official eval scripts for JobBench☆31Jul 18, 2026Updated last week
- ☆134Mar 31, 2026Updated 3 months ago
- ☆152Jul 21, 2026Updated last week
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆532Updated this week
- A benchmark to evaluate search-augmented LLMs☆17Aug 28, 2025Updated 11 months ago
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆472Jul 22, 2026Updated last week
- A benchmark for evaluating AI agents on realistic business workflows☆158Jul 16, 2026Updated last week
- LLM-powered MCP server for building financial deep-research agents, integrating web search, Crawl4AI scraping, and entity extraction into…☆24Feb 11, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆75Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,102Updated this week
- ☆40Jun 8, 2026Updated last month
- Official repository for SaaS-Bench: realistic, locally deployable SaaS workflows for GUI agent evaluation.☆91Jun 5, 2026Updated last month
- Χ-Bench: Can AI Agents Automate End-to-End, Long-Horizon, Policy-Rich Healthcare Workflows?☆54Updated this week
- AI-powered terminal assistant for LaTeX academic papers — verifies, fixes, and polishes your paper for conference submission with reviewa…☆19Feb 14, 2026Updated 5 months ago
- Toolathlon-Gym for testing AI agents real-world tool-use capabilities across diverse MCP servers.☆140Jul 22, 2026Updated last week
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆288Updated this week
- 💻 SETA: Scaling Environments for Terminal Agents - Environments☆143Feb 16, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆145May 6, 2026Updated 2 months ago
- ☆19Jun 18, 2026Updated last month
- ☆23Feb 4, 2026Updated 5 months ago
- GRPO training code which scales to 32xH100s for long horizon terminal/coding tasks. Base agent is now the top Qwen3 agent on Stanford's T…☆398Aug 24, 2025Updated 11 months ago
- Claw-Eval is an evaluation harness for evaluating LLM as agents. All tasks verified by humans.☆736May 17, 2026Updated 2 months ago
- Programmable chat templates for LLM training and inference.☆135Updated this week
- A benchmark for evaluating LLM × harness performance.☆96Jul 22, 2026Updated last week
- A benchmark for LLMs on complicated tasks in the terminal☆2,495Jul 11, 2026Updated 2 weeks ago
- FrontierSmith, a new system that uses AI to synthesize open-ended coding problems at scale☆50May 30, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆38Jul 20, 2026Updated last week
- ☆24Mar 1, 2025Updated last year
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆312Jul 13, 2025Updated last year
- Tinkering RL☆26Jul 15, 2026Updated 2 weeks ago
- Evals Harness for $OneMillion-Bench☆48Apr 21, 2026Updated 3 months ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆1,343Jul 4, 2026Updated 3 weeks ago
- Can Language Models Rebuild Programs From Scratch?☆865Updated this week