Alternatives and similar repositories for polyglot-benchmark

Users that are interested in polyglot-benchmark are comparing it to the libraries listed below

• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆382Updated this week
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆479Updated this week
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆114Updated 2 months ago
• ScalingIntelligence / codemonkeys
  ☆59Updated 10 months ago
• Aider-AI / refactor-benchmark
  Aider's refactoring benchmark exercises based on popular python repos
  ☆78Updated last year
• laude-institute / harbor
  ☆152Updated this week
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆78Updated last year
• MoonshotAI / K2-Vendor-Verifier
  Verify Precision of all Kimi K2 API Vendor
  ☆461Updated 2 weeks ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆225Updated this week
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆182Updated 6 months ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆117Updated last year
• scaleapi / SWE-bench_Pro-os
  SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
  ☆220Updated 2 weeks ago
• PrimeIntellect-ai / genesys
  ☆136Updated 8 months ago
• OpenHands / software-agent-sdk
  A clean, modular SDK for building AI agents with OpenHands V1.
  ☆224Updated this week
• simple-bench / SimpleBench
  ☆179Updated 11 months ago
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆265Updated 6 months ago
• aorwall / moatless-tree-search
  ☆126Updated 6 months ago
• aorwall / moatless-tools
  ☆613Updated 3 months ago
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆282Updated this week
• llllvvuu / instant_apply
  proof-of-concept of Cursor's Instant Apply feature
  ☆87Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 9 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 9 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆118Updated 7 months ago
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆278Updated last month
• NL2Code / CodeR
  ☆159Updated last year
• metauto-ai / HGM
  🧬 The Huxley-Gödel Machine
  ☆305Updated last week
• pseudotensor / open-strawberry
  Building open version of OpenAI o1 via reasoning traces (Groq, ollama, Anthropic, Gemini, OpenAI, Azure supported) Demo: https://hugging…
  ☆187Updated last year
• OpenHands / trajectory-visualizer
  ☆39Updated last month
• willccbb / claude-deep-research
  Claude Deep Research config for Claude Code.
  ☆223Updated 8 months ago
• codestoryai / sidecar
  Sidecar is the AI brains for the Aide editor and works alongside it, locally on your machine
  ☆588Updated 6 months ago