Evaluation harness for OpenHands V1.
☆134Nov 9, 2026Updated last week
Alternatives and similar repositories for benchmarks
Users that are interested in benchmarks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OpenHands automation service☆51Updated this week
- A clean, modular SDK for building AI agents with OpenHands V1.☆1,409Updated this week
- All Hands AI OpenHands Self-hosted Cloud☆95Updated this week
- Results for the OpenHands Index☆11Jul 8, 2026Updated 4 months ago
- Agent computer interface for AI software engineer.☆141Apr 16, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Aggregated documentations across multiple repos, including OpenHands, agent-sdk, etc.☆19Updated this week
- Repo for collaboration on OSS agentic code search☆93Oct 26, 2026Updated 3 weeks ago
- ☆16Nov 1, 2025Updated last year
- ☆37Mar 7, 2026Updated 8 months ago
- ☆14Mar 5, 2025Updated last year
- [ICML 2024]: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models☆11May 19, 2024Updated 2 years ago
- This synthetic benchmark dataset is designed to evaluate models based on features extracted from user telemetry data.☆15May 16, 2026Updated 6 months ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆835Updated this week
- Lightweight, local-first Python DAG workflow compiler and execution engine with human-in-the-loop checkpoints for CLI and AI-agent workfl…☆19Nov 5, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- CodeJudgeBench is a benchmark aimed at evaluating LLM-based judges for coding related tasks.☆10Feb 14, 2026Updated 9 months ago
- OpenHands Agent Canvas is a Open Source AI coding platform. Start locally, connect your tools, and automate workflows.☆237Jul 27, 2026Updated 3 months ago
- ☆25Jun 11, 2026Updated 5 months ago
- Contenu pédagogique pour le cours de M2 du master TAL de l'INALCO par Louis Jourdain☆13May 14, 2025Updated last year
- A system that tries to resolve all issues on a github repo with OpenHands.☆134Nov 18, 2024Updated 2 years ago
- [FSE'2026] SWE-Factory: Your Automated Factory for Issue Resolution Training Data and Evaluation Benchmarks☆203May 12, 2026Updated 6 months ago
- [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.☆69Jul 21, 2025Updated last year
- Official implementation for the paper, StackEval: Benchmarking LLMs in Coding Assistance, https://arxiv.org/abs/2412.05288☆22Oct 30, 2024Updated 2 years ago
- ☆99Jul 21, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Sep 4, 2026Updated 2 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Jun 13, 2024Updated 2 years ago
- An AI agent with sandboxed JavaScript execution, powered by Hyperlight micro-VMs and the GitHub Copilot SDK. Ask it to compute things — i…☆24Updated this week
- Ready-to-use harnesses for OpenReward environments☆13Sep 21, 2026Updated last month
- SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding [ACL 2026]☆15Jun 26, 2026Updated 4 months ago
- Mixture-of-Basis-Experts for Compressing MoE-based LLMs☆41Updated this week
- [NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!☆263Nov 8, 2026Updated last week
- Framework for evaluating and improving agents☆7,205Updated this week
- ☆20Oct 15, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆6,216Sep 18, 2026Updated 2 months ago
- ☆12Apr 16, 2025Updated last year
- Universal LLM security auditor with automated jailbreak testing, DSPy optimization, and OWASP 2025-aligned attack patterns☆22Oct 23, 2025Updated last year
- Welcoming contributions from practitioners building AI/data systems - share your real-world problems, document where current tools fail, …☆14Sep 4, 2025Updated last year
- Windows kernel and bootmgfw obfuscated and running☆15Nov 16, 2025Updated last year
- The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—b…☆9,748Updated this week
- Pier is a Harbor fork built for DeepSWE, with stronger support for CLI agents in air-gapped (no-internet) tasks and more faithful, consis…☆236Oct 29, 2026Updated 2 weeks ago
Are these results useful?