Run SWE-bench evaluations remotely
☆84Aug 14, 2025Updated last year
Alternatives and similar repositories for sb-cli
Users that are interested in sb-cli are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆835Updated this week
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆651Updated this week
- ☆139May 8, 2025Updated last year
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆286Sep 3, 2026Updated 2 months ago
- Benchmarking Goal-Oriented Software Engineering☆218Jul 16, 2026Updated 4 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆14Mar 5, 2025Updated last year
- Docker image registry for SWE-bench, created by Epoch AI.☆20Aug 21, 2025Updated last year
- Implementation based on the paper "ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory"☆11Oct 31, 2025Updated last year
- Spawn thousands of sub-agents in parallel☆14Aug 10, 2026Updated 3 months ago
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆6,216Sep 18, 2026Updated 2 months ago
- A manager for terminal+IDE projects☆24Nov 12, 2026Updated last week
- Public agent skills catalog for Harbor☆15May 12, 2026Updated 6 months ago
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆353Jul 13, 2025Updated last year
- Convert GitHub PRs into Harbor tasks☆91Jul 13, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ACL25] FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation☆63Jan 28, 2026Updated 9 months ago
- A curated list of awesome Harbor ecosystem projects☆62May 29, 2026Updated 5 months ago
- Issue tracker for Piebald, the ultimate agentic AI control experience for developers.☆11Nov 11, 2026Updated last week
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆764Nov 1, 2026Updated 2 weeks ago
- A simple, fast local viewer for your Claude Code sessions.☆18Oct 8, 2025Updated last year
- ☆17Updated this week
- Trajectory Recording and Capture Environments☆19Jan 24, 2026Updated 9 months ago
- ☆14Nov 11, 2026Updated last week
- Submit your results on SWE-bench-Live☆14Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The cloud for Splitrail - analyzer for agentic AI coding tool usage. Sync your usage data across devices, and optionally show off your st…☆14Oct 19, 2026Updated 3 weeks ago
- Multi-agent synthetic data generation pipeline capable of generating and validating long horizon terminal/coding tasks for RL training☆76Jul 28, 2025Updated last year
- Ready-to-use harnesses for OpenReward environments☆13Sep 21, 2026Updated last month
- Optimal stopping package for LLM evaluations☆25Sep 13, 2026Updated 2 months ago
- Cognition's results and methodology on SWE-bench☆125Mar 15, 2024Updated 2 years ago
- Part of Cognitum platform (see cognitum-one/cognitum meta-repo)☆22Oct 26, 2026Updated 3 weeks ago
- client.dev microsite☆18Apr 13, 2026Updated 7 months ago
- Kotlin 实现的Apkdiff算法 实现了诱导排序求后缀数组、kotlin版本的bsdiff、APK的无损解压缩算法☆14May 8, 2025Updated last year
- ☆11Jun 25, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment☆152Apr 20, 2025Updated last year
- List of HuggingFace models tracked by Interconnects AI for open model analytics☆12Updated this week
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆722Mar 16, 2025Updated last year
- ☆18Apr 1, 2024Updated 2 years ago
- OpenPipe Reinforcement Learning Experiments☆34Mar 14, 2025Updated last year
- Is Neuron Coverage a Meaningful Measure for Testing Deep Neural Networks? (FSE 2020)☆10Sep 23, 2021Updated 5 years ago
- NLSpec instruction following benchmark for https://factory.strongdm.ai/products/attractor☆23Feb 26, 2026Updated 8 months ago
Are these results useful?