Framework for evaluating and improving agents
☆5,571Sep 24, 2026Updated this week
Alternatives and similar repositories for harbor
Users that are interested in harbor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A benchmark for LLMs on complicated tasks in the terminal☆2,593Jul 11, 2026Updated 2 months ago
- Realistic examples of building evals and optimizing agents with Harbor☆221Apr 23, 2026Updated 5 months ago
- Measuring and evolving with the frontier of agent work☆766Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,346Updated this week
- ☆415Apr 30, 2026Updated 4 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- slime is an LLM post-training framework for RL Scaling.☆8,527Updated this week
- SkillsBench evaluates how well skills work and how effective agents are at using them.☆1,813Jul 23, 2026Updated 2 months ago
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆23,601Updated this week
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆489Aug 18, 2026Updated last month
- Democratizing Reinforcement Learning for LLMs☆5,836Sep 12, 2026Updated last week
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆335Jul 13, 2025Updated last year
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆786Updated this week
- Our library for RL environments + evals☆4,650Updated this week
- Agentic RL Training at Scale☆2,081Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆2,979Updated this week
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆5,897Sep 18, 2026Updated last week
- The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—b…☆7,948Updated this week
- Data recipes and robust infrastructure for training AI agents☆295Updated this week
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆567Updated this week
- Pier is a Harbor fork built for DeepSWE, with stronger support for CLI agents in air-gapped (no-internet) tasks and more faithful, consis…☆196Updated this week
- ☆44May 16, 2026Updated 4 months ago
- τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains☆2,102Updated this week
- Agentic RL on Any Harness at Scale☆843Aug 13, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Can Language Models Rebuild Programs From Scratch?☆931Updated this week
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆745Jul 29, 2025Updated last year
- Convert GitHub PRs into Harbor tasks☆85Jul 13, 2026Updated 2 months ago
- The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.☆5,793Updated this week
- An interface library for RL post training with environments.☆2,606Updated this week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆36,404Updated this week
- A curated list of awesome Harbor ecosystem projects☆53May 29, 2026Updated 3 months ago
- Post-training with Tinker☆4,147Updated this week
- Multi-agent synthetic data generation pipeline capable of generating and validating long horizon terminal/coding tasks for RL training☆74Jul 28, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- SWE-Marathon: an ultra long-horizon SWE benchmark☆164Updated this week
- A framework for few-shot evaluation of language models.☆14,067Sep 14, 2026Updated last week
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Asy…☆10,042Sep 17, 2026Updated last week
- Harness for running and evaluating AI agents against RL environments☆280Updated this week
- Meta-Harness: 76.4% on Terminal-Bench 2.0 (Claude Opus 4.6)☆1,225Mar 26, 2026Updated 5 months ago
- GRPO training code which scales to 32xH100s for long horizon terminal/coding tasks. Base agent is now the top Qwen3 agent on Stanford's T…☆412Aug 24, 2025Updated last year
- Code and Data for Tau-Bench☆1,445Mar 18, 2026Updated 6 months ago