Framework for evaluating and improving agents
☆6,784Nov 4, 2026Updated this week
Alternatives and similar repositories for harbor
Users that are interested in harbor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A benchmark for LLMs on complicated tasks in the terminal☆2,614Jul 11, 2026Updated 3 months ago
- Realistic examples of building evals and optimizing agents with Harbor☆264Updated this week
- Measuring and evolving with the frontier of agent work☆999Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,495Updated this week
- slime is an LLM training framework for RL Scaling.☆8,786Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆440Apr 30, 2026Updated 6 months ago
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆24,116Updated this week
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆3,266Updated this week
- SkillsBench evaluates how well skills work and how effective agents are at using them.☆1,896Updated this week
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆6,143Sep 18, 2026Updated last month
- The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—b…☆9,056Updated this week
- AgentENV (AENV) is a distributed platform for running agent environments at scale.☆3,725Updated this week
- Our library for RL environments + evals☆4,764Updated this week
- Democratizing Reinforcement Learning for LLMs☆5,908Oct 16, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆822Updated this week
- Pier is a Harbor fork built for DeepSWE, with stronger support for CLI agents in air-gapped (no-internet) tasks and more faithful, consis…☆224Updated this week
- An interface library for RL post training with environments.☆2,829Updated this week
- Agentic RL Training at Scale☆2,215Updated this week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆38,452Updated this week
- Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours☆612Updated this week
- Terminal-Bench-Science: Evaluating AI agents on research workflows across scientific domains☆820Updated this week
- τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains☆2,393Updated this week
- Inspect: A framework for large language model evaluations☆3,169Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Agentic RL on Any Harness at Scale☆869Updated this week
- The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.☆5,896Updated this week
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆120,017Updated this week
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆347Jul 13, 2025Updated last year
- A framework for few-shot evaluation of language models.☆14,387Sep 14, 2026Updated last month
- Optimize prompts, code, and more with AI-powered Reflective Optimization☆7,277Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,299Updated this week
- [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution☆513Aug 18, 2026Updated 2 months ago
- Can Language Models Rebuild Programs From Scratch?☆980Oct 12, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Post-training with Tinker☆4,236Updated this week
- DSPy: The framework for programming—not prompting—language models☆38,904Updated this week
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Asy…☆10,142Updated this week
- Data recipes and robust infrastructure for training AI agents☆309Oct 23, 2026Updated last week
- Train transformer language models with reinforcement learning.☆19,669Updated this week
- The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails…☆62,695Updated this week
- A self-improving RLM agent for coding workflows and long-running autonomous tasks.☆22,570Updated this week