Alternatives and similar repositories for polyglot-benchmark

Users that are interested in polyglot-benchmark are comparing it to the libraries listed below

• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆315Updated this week
• SWE-bench / SWE-smith
  Scaling Data for SWE-agents
  ☆399Updated this week
• kortix-ai / fast-apply
  ☆344Updated 2 months ago
• Aider-AI / refactor-benchmark
  Aider's refactoring benchmark exercises based on popular python repos
  ☆77Updated 11 months ago
• codestoryai / sidecar
  Sidecar is the AI brains for the Aide editor and works alongside it, locally on your machine
  ☆585Updated 4 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆109Updated 2 weeks ago
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆179Updated 4 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆210Updated this week
• aorwall / moatless-tools
  ☆593Updated 2 weeks ago
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆75Updated last year
• lmarena / copilot-arena
  ☆323Updated 4 months ago
• aorwall / moatless-tree-search
  ☆111Updated 3 months ago
• llllvvuu / instant_apply
  proof-of-concept of Cursor's Instant Apply feature
  ☆83Updated last year
• simple-bench / SimpleBench
  ☆165Updated 8 months ago
• ScalingIntelligence / codemonkeys
  ☆55Updated 7 months ago
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆254Updated 4 months ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆113Updated 9 months ago
• hide-org / hide
  🤖 Headless IDE for AI agents
  ☆201Updated 4 months ago
• pseudotensor / open-strawberry
  Building open version of OpenAI o1 via reasoning traces (Groq, ollama, Anthropic, Gemini, OpenAI, Azure supported) Demo: https://hugging…
  ☆183Updated 11 months ago
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆121Updated 6 months ago
• lechmazur / confabulations
  Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
  ☆225Updated last month
• RooCodeInc / Roo-Code-Evals
  Eval exercises for Roo Code.
  ☆62Updated 3 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆108Updated 4 months ago
• willccbb / claude-deep-research
  Claude Deep Research config for Claude Code.
  ☆214Updated 6 months ago
• laude-institute / terminal-bench
  A benchmark for LLMs on complicated tasks in the terminal
  ☆691Updated this week
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆172Updated this week
• harishsg993010 / LLM-Research-Scripts
  ☆433Updated 11 months ago
• All-Hands-AI / open-operator
  Open-source resources on agents for computer use.
  ☆371Updated 7 months ago
• NL2Code / CodeR
  ☆159Updated last year
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆135Updated 6 months ago