Alternatives and similar repositories for copilot-arena

Users that are interested in copilot-arena are comparing it to the libraries listed below

• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆199Updated last year
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆185Updated 8 months ago
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆358Updated 9 months ago
• MoonshotAI / K2-Vendor-Verifier
  Verify Precision of all Kimi K2 API Vendor
  ☆507Updated 2 weeks ago
• JonathanChavezTamales / llm-leaderboard
  A comprehensive set of LLM benchmark scores and provider prices. (deprecated, read more in README)
  ☆359Updated 3 months ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆117Updated last year
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆116Updated 2 months ago
• jd-3d / SOLOBench
  ☆135Updated 9 months ago
• OpenHands / open-operator
  Open-source resources on agents for computer use.
  ☆398Updated 4 months ago
• pseudotensor / open-strawberry
  Building open version of OpenAI o1 via reasoning traces (Groq, ollama, Anthropic, Gemini, OpenAI, Azure supported) Demo: https://hugging…
  ☆188Updated last year
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆430Updated last week
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆199Updated last week
• harishsg993010 / LLM-Research-Scripts
  ☆434Updated last year
• togethercomputer / finetuning
  Finetune Llama-3-8b on the MathInstruct dataset
  ☆115Updated last year
• tcsenpai / multi1
  multi1: create o1-like reasoning chains with multiple AI providers (and locally). Supports LiteLLM as backend too for 100+ providers at o…
  ☆350Updated last year
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆264Updated last year
• codestoryai / prompts
  Contains the prompts we use to talk to various LLMs for different utilities inside the editor
  ☆84Updated 2 years ago
• simple-bench / SimpleBench
  ☆190Updated last year
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆79Updated last year
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆271Updated 9 months ago
• lechmazur / confabulations
  Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
  ☆243Updated 6 months ago
• SWE-bench / SWE-smith
  [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents
  ☆538Updated last week
• MattFlower / vscode-aider-extension
  ☆109Updated last year
• willccbb / claude-code-mcp
  Letting Claude Code develop his own MCP tools :)
  ☆123Updated 11 months ago
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆336Updated last week
• janhq / ReZero
  ☆159Updated 9 months ago
• cfahlgren1 / qwen-2.5-code-interpreter
  Qwen 2.5 Coder 1.5B with Code Interpreter
  ☆288Updated last year
• LLMSELECTOR / LLMSELECTOR
  ☆80Updated 4 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆239Updated last year
• llllvvuu / instant_apply
  proof-of-concept of Cursor's Instant Apply feature
  ☆88Updated last year