Framework for evaluating and improving agents
☆2,788Jun 29, 2026Updated last week
Alternatives and similar repositories for harbor
Users that are interested in harbor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A benchmark for LLMs on complicated tasks in the terminal☆2,398Jan 22, 2026Updated 5 months ago
- ☆316Apr 30, 2026Updated 2 months ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆2,045Updated this week
- Multi-agent synthetic data generation pipeline capable of generating and validating long horizon terminal/coding tasks for RL training☆67Jul 28, 2025Updated 11 months ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆688Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Our library for RL environments + evals☆4,254Updated this week
- [COLING25] CodeJudge Eval: Can Large Language Models be Good Judges in Code Understanding?☆12Dec 3, 2024Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆35Apr 17, 2025Updated last year
- Regressing the Relative Future: Efficient Policy Optimization for Multi-turn RLHF☆25Oct 8, 2024Updated last year
- ☆304Updated this week
- A local-first evidence layer for agent work, capturing what the agent sees, does, and changes.☆80Jun 28, 2026Updated last week
- ☆45Mar 6, 2026Updated 4 months ago
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆5,346Apr 1, 2026Updated 3 months ago
- ☆85Feb 28, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- GRPO training code which scales to 32xH100s for long horizon terminal/coding tasks. Base agent is now the top Qwen3 agent on Stanford's T…☆393Aug 24, 2025Updated 10 months ago
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆22,312Updated this week
- slime is an LLM post-training framework for RL Scaling.☆7,099Jun 29, 2026Updated last week
- Democratizing Reinforcement Learning for LLMs☆5,677Updated this week
- A framework for few-shot evaluation of language models.☆13,106Jun 24, 2026Updated last week
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆700Jul 29, 2025Updated 11 months ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆29,914Updated this week
- ☆4,558Apr 22, 2026Updated 2 months ago
- Evaluation utilities based on SymPy.☆22Dec 12, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Codebase for EnterpriseOps-Gym from ServiceNow☆99Jun 3, 2026Updated last month
- Agentic Research and Evaluation Suite☆104Jun 11, 2026Updated 3 weeks ago
- Benchmarking Goal-Oriented Software Engineering☆175Jun 25, 2026Updated last week
- Agentic RL Training at Scale☆1,566Updated this week
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆894Jul 16, 2025Updated 11 months ago
- ☆12Feb 11, 2026Updated 4 months ago
- τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains☆1,460Jun 25, 2026Updated last week
- Training a model similar to OpenAI DALL-E with volunteers from all over the Internet using hivemind and dalle-pytorch (NeurIPS 2021 demo)☆27May 29, 2023Updated 3 years ago
- DSPy: The framework for programming—not prompting—language models☆35,605Jun 25, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆29Apr 7, 2026Updated 2 months ago
- A construction kit for reinforcement learning environment management.☆465Updated this week
- AllenAI's post-training codebase☆3,775Jun 27, 2026Updated last week
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆300Jul 13, 2025Updated 11 months ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆2,076Dec 22, 2024Updated last year
- 🌎💪 BrowserGym, a Gym environment for web task automation☆1,260Mar 17, 2026Updated 3 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆407Updated this week