Evaluation harness for OpenHands V1.
☆128Sep 4, 2026Updated last month
Alternatives and similar repositories for benchmarks
Users that are interested in benchmarks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A clean, modular SDK for building AI agents with OpenHands V1.☆1,299Updated this week
- All Hands AI OpenHands Self-hosted Cloud☆87Updated this week
- Public registry for OpenHands extensions.☆173Updated this week
- Agent computer interface for AI software engineer.☆139Apr 16, 2026Updated 6 months ago
- ☆14Mar 5, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Nov 1, 2025Updated 11 months ago
- ☆186May 13, 2026Updated 5 months ago
- Aggregated documentations across multiple repos, including OpenHands, agent-sdk, etc.☆16Updated this week
- Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end refere…☆16May 27, 2026Updated 4 months ago
- [FSE'2026] SWE-Factory: Your Automated Factory for Issue Resolution Training Data and Evaluation Benchmarks☆202May 12, 2026Updated 5 months ago
- [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.☆66Jul 21, 2025Updated last year
- ☆18Mar 28, 2026Updated 6 months ago
- BenchPress: calibrated LLM benchmark score completion☆34Oct 4, 2026Updated 2 weeks ago
- ☆95Jul 21, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—b…☆8,785Updated this week
- ALAS: Autonomous Learning Agent System☆19Aug 14, 2025Updated last year
- Framework for evaluating and improving agents☆6,412Updated this week
- Mixture-of-Basis-Experts for Compressing MoE-based LLMs☆40Dec 24, 2025Updated 9 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Jun 13, 2024Updated 2 years ago
- Welcoming contributions from practitioners building AI/data systems - share your real-world problems, document where current tools fail, …☆14Sep 4, 2025Updated last year
- Automatica Open Web Data Collection (NeurIPS 2025)☆16Dec 2, 2025Updated 10 months ago
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆6,073Sep 18, 2026Updated last month
- Universal LLM security auditor with automated jailbreak testing, DSPy optimization, and OWASP 2025-aligned attack patterns☆22Oct 23, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Continual Memorization of Factoids in Large Language Models☆12Nov 20, 2024Updated last year
- Official Implementation for "Nearest Is Not Dearest: Towards Practical Defense against Quantization-conditioned Backdoor Attacks" (CVPR 2…☆12Aug 14, 2024Updated 2 years ago
- ☆20May 18, 2025Updated last year
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?☆550Sep 22, 2026Updated last month
- SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents☆90Aug 14, 2026Updated 2 months ago
- Scalable, cloud-native infrastructure for evaluating AI agents across any benchmark.☆54Updated this week
- Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.☆623Updated this week
- DuckDB-powered SQL executor for local AWS Athena and Firehose emulation☆13Oct 7, 2026Updated 2 weeks ago
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆342Jul 13, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution☆105Sep 24, 2025Updated last year
- SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training☆110Feb 28, 2026Updated 7 months ago
- ☆12Oct 31, 2025Updated 11 months ago
- Cloud platform control plane for markco.dev (orchestrator, auth, compute, publish, resource-monitor)☆12Mar 8, 2026Updated 7 months ago
- ICU - International Components for Unicode☆13Sep 12, 2026Updated last month
- ☆430Apr 30, 2026Updated 5 months ago
- ☆138May 8, 2025Updated last year