Alternatives and similar repositories for polyglot-benchmark

Users that are interested in polyglot-benchmark are comparing it to the libraries listed below

• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆430Updated this week
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆538Updated last week
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆116Updated 2 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆246Updated last week
• MoonshotAI / K2-Vendor-Verifier
  Verify Precision of all Kimi K2 API Vendor
  ☆507Updated 2 weeks ago
• aorwall / moatless-tree-search
  ☆132Updated 8 months ago
• laude-institute / harbor
  Harbor is a framework for running agent evaluations and creating and using RL environments.
  ☆542Updated this week
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆259Updated last month
• Aider-AI / refactor-benchmark
  Aider's refactoring benchmark exercises based on popular python repos
  ☆78Updated last year
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆79Updated last year
• ScalingIntelligence / codemonkeys
  ☆59Updated last year
• simple-bench / SimpleBench
  ☆190Updated last year
• InternLM / SWE-Fixer
  ☆131Updated 9 months ago
• OpenHands / software-agent-sdk
  A clean, modular SDK for building AI agents with OpenHands V1.
  ☆491Updated this week
• aorwall / moatless-tools
  ☆624Updated 5 months ago
• NL2Code / CodeR
  ☆159Updated last year
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆53Updated 5 months ago
• ozyyshr / RepoGraph
  Enhancing AI Software Engineering with Repository-level Code Graph
  ☆248Updated 10 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 11 months ago
• OpenAutoCoder / live-swe-agent
  Live-SWE-agent: live, runtime self-evolving software engineering agent
  ☆240Updated 3 weeks ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆117Updated last year
• THUDM / SWE-Dev
  [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.
  ☆58Updated 6 months ago
• kortix-ai / fast-apply
  ☆392Updated 4 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆199Updated last week
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆185Updated 8 months ago
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆271Updated 9 months ago
• PrimeIntellect-ai / genesys
  ☆137Updated 10 months ago
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆123Updated 11 months ago
• OpenHands / open-operator
  Open-source resources on agents for computer use.
  ☆398Updated 4 months ago
• adityasoni9998 / OpenHands-Versa
  Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"
  ☆97Updated 3 months ago