Benchmark how well any model performs real-world, long-horizon coding tasks across coding agents (harnesses) -- Claude Code and pi. Run models three ways -- Anthropic on Amazon Bedrock, open-weight on Bedrock via a LiteLLM proxy, or self-hosted on EC2 with vLLM -- score them with an LLM judge, and plot the cost/quality Pareto frontier.
☆16Nov 2, 2026Updated this week
Alternatives and similar repositories for agentic-coding-harness-benchmarks
Users that are interested in agentic-coding-harness-benchmarks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A jruby wrapper to lucene☆16Aug 9, 2016Updated 10 years ago
- Turn ambiguous software-change requests into a durable, Beads-backed lifecycle from specification to human-approved implementation and ve…☆17Oct 23, 2026Updated 2 weeks ago
- ☆10Jul 18, 2023Updated 3 years ago
- Codes for our paper "AgentMonitor: A Plug-and-Play Framework for Predictive and Secure Multi-Agent Systems"☆14Dec 13, 2024Updated last year
- A session multiplexer for Claude Code in tmux (maintenance mode — see README)☆29Aug 15, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🛡️SCR-Bench evaluates security risks in LLM agent skill ecosystems: skills that appear benign in isolation can become harmful in composi…☆17Jun 21, 2026Updated 4 months ago
- On the Robustness of GUI Grounding Models Against Image Attacks☆12Apr 8, 2025Updated last year
- [EMNLP2026 Findings] TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories☆21Sep 7, 2026Updated 2 months ago
- [ACL 2026 Main] ACIArena: Toward Unified Evaluation for Agent Cascading Injection☆17Aug 9, 2026Updated 2 months ago
- Go bindings to the openssl library☆33Oct 24, 2018Updated 8 years ago
- The Rul Programming Language For AI/SI Agents.☆48Updated this week
- CopyrightMeter: Revisiting Copyright Protection in Text-to-image Models☆14Nov 22, 2024Updated last year
- Port of Qless' web interface to the Openresty environment.☆13Apr 19, 2017Updated 9 years ago
- [EMNLP 2025] VideoEraser: Concept Erasure in Text-to-Video Diffusion Models☆14Nov 23, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Claude Code + Codex 双平台 AI dotfiles：统一管理 skills/agents/hooks，并一键同步到 ~/.claude 与 ~/.codex。☆14Oct 17, 2026Updated 3 weeks ago
- Orchestrating multiple Claude Code agents in devcontainers.☆15Jan 6, 2026Updated 10 months ago
- ☆14Feb 9, 2026Updated 8 months ago
- setting up Mac as much as automatically!☆11Oct 4, 2026Updated last month
- ☆10Oct 31, 2019Updated 7 years ago
- A remote control for the pi coding agent. Windows-native, zero third parties.☆10Oct 23, 2026Updated 2 weeks ago
- SHE: Trajectory-driven Safety Harness Evolution for LLM Agents☆24Aug 4, 2026Updated 3 months ago
- This is all items relating to Microsoft Fabric Workloads☆11Sep 23, 2026Updated last month
- [EMNLP 2026] PISanitizer: Preventing Prompt Injection to Long-Context LLMs via Prompt Sanitization☆20Aug 21, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Sep 25, 2026Updated last month
- asmsense: a small model that names and describes functions in stripped x86-64 binaries. Open dataset, baselines, and LoRA experiments.☆20Updated this week
- [ACL 2025] Guiding not Forcing: Enhancing the Transferability of Jailbreaking Attacks on LLMs via Removing Superfluous Constraints☆19May 23, 2025Updated last year
- Deckard is a framework agnostic tool for running database migrations.☆12Oct 12, 2022Updated 4 years ago
- ⚡ AI Automation Engine☆18Jun 30, 2026Updated 4 months ago
- Terraform provider for managing SQL schemas using migrations.☆14Jun 1, 2020Updated 6 years ago
- ☆15Oct 24, 2022Updated 4 years ago
- Integrating Amazon API Gateway private endpoints with on-premises networks☆12Jul 9, 2021Updated 5 years ago
- My emacs setup☆17Oct 30, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Turn your RP2350 board into a retro console — an on-screen boot menu that flashes and launches emulators and Doom straight from the SD ca…☆14Updated this week
- Unified Python interface for invoking AI coding-agent CLIs (claude-code, opencode, codex, gemini, aider, swe-agent) as subprocesses.☆29Oct 3, 2026Updated last month
- Open-source AI chatbot trained on your data, deployable on Cloudflare Workers for free.☆14Aug 29, 2026Updated 2 months ago
- Event-driven image moderation and notification with AWS CDK☆11Dec 2, 2021Updated 4 years ago
- Research methods for reverse engineering encrypted firmware and software with AI-assisted analysis, independent validation, and public-so…☆13Oct 27, 2026Updated last week
- Docker-based monitoring stack for Claude Code CLI. Track costs, tokens, cache efficiency, and events using OpenTelemetry, Prometheus, Lok…☆11Feb 22, 2026Updated 8 months ago
- Tools to optimize your linux server and config your vpn tunnel☆21Jan 30, 2025Updated last year