Alternatives and similar repositories for polyglot-benchmark

Users that are interested in polyglot-benchmark are comparing it to the libraries listed below

• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆247Updated this week
• Aider-AI / refactor-benchmark
  Aider's refactoring benchmark exercises based on popular python repos
  ☆75Updated 9 months ago
• SWE-bench / SWE-smith
  Scaling Data for SWE-agents
  ☆293Updated this week
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆89Updated this week
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆234Updated this week
• All-Hands-AI / open-operator
  Open-source resources on agents for computer use.
  ☆354Updated 5 months ago
• kortix-ai / fast-apply
  ☆310Updated 3 weeks ago
• vaibhavagg303 / DARS-Agent
  ☆64Updated last month
• simple-bench / SimpleBench
  ☆132Updated 6 months ago
• codestoryai / sidecar
  Sidecar is the AI brains for the Aide editor and works alongside it, locally on your machine
  ☆576Updated 2 months ago
• llllvvuu / instant_apply
  proof-of-concept of Cursor's Instant Apply feature
  ☆83Updated 10 months ago
• willccbb / claude-deep-research
  Claude Deep Research config for Claude Code.
  ☆196Updated 4 months ago
• aorwall / moatless-tree-search
  ☆94Updated last month
• codestoryai / prompts
  Contains the prompts we use to talk to various LLMs for different utilities inside the editor
  ☆79Updated last year
• NL2Code / CodeR
  ☆158Updated 10 months ago
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆241Updated 2 months ago
• benchflow-ai / benchflow
  AI benchmark runtime framework that allows you to integrate and evaluate AI tasks using Docker-based benchmarks.
  ☆154Updated 2 months ago
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆72Updated last year
• lmarena / copilot-arena
  ☆312Updated 2 months ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆110Updated 7 months ago
• aorwall / moatless-tools
  ☆490Updated 3 weeks ago
• CEDARScript / cedarscript-grammar
  A SQL-like language for efficient code analysis and transformations
  ☆35Updated 6 months ago
• generalagents / showdown
  The Showdown Computer Control Evaluation Suite
  ☆79Updated 3 months ago
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆178Updated 2 months ago
• hide-org / hide
  🤖 Headless IDE for AI agents
  ☆192Updated 2 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆191Updated last week
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆39Updated last week
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆114Updated 4 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆84Updated 9 months ago
• CEDARScript / cedarscript-integration-aider
  Allows Aider to use CEDARScript as an edit format
  ☆29Updated 7 months ago