Alternatives and similar repositories for copilot-arena

Users that are interested in copilot-arena are comparing it to the libraries listed below

• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆155Updated 6 months ago
• togethercomputer / finetuning
  Finetune Llama-3-8b on the MathInstruct dataset
  ☆110Updated 9 months ago
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆263Updated 9 months ago
• harishsg993010 / LLM-Research-Scripts
  ☆434Updated 9 months ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆110Updated 8 months ago
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆320Updated 3 months ago
• simple-bench / SimpleBench
  ☆132Updated 6 months ago
• lmarena / p2l
  Prompt-to-Leaderboard
  ☆241Updated 2 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆247Updated this week
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆178Updated 2 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆89Updated this week
• SWE-bench / SWE-smith
  Scaling Data for SWE-agents
  ☆293Updated this week
• All-Hands-AI / open-operator
  Open-source resources on agents for computer use.
  ☆357Updated 5 months ago
• simular-ai / OpenACI
  Open Agent Computer Interface
  ☆77Updated 7 months ago
• mshumer / OpenReasoningEngine
  ☆183Updated 7 months ago
• agora-protocol / paper-demo
  ☆162Updated 4 months ago
• EQ-bench / EQ-Bench
  A benchmark for emotional intelligence in large language models
  ☆323Updated 11 months ago
• WhitzardIndex / self-replication-research
  A preprint version of our recent research on the capability of frontier AI systems to do self-replication
  ☆60Updated 7 months ago
• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆488Updated last week
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆284Updated this week
• LLMSELECTOR / LLMSELECTOR
  ☆71Updated 4 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆217Updated last year
• gradio-app / openai-gradio
  ☆315Updated 7 months ago
• pseudotensor / open-strawberry
  Building open version of OpenAI o1 via reasoning traces (Groq, ollama, Anthropic, Gemini, OpenAI, Azure supported) Demo: https://hugging…
  ☆181Updated 9 months ago
• qunash / r1-overthinker
  Force DeepSeek r1 models to think for as long as you wish
  ☆369Updated 5 months ago
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆236Updated this week
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆138Updated last year
• hammer-mt / DSPyUI
  A user interface for DSPy
  ☆162Updated last month
• vaibhavagg303 / DARS-Agent
  ☆64Updated last month
• Mustafa-Esoofally / AI-researcher-phidata
  ☆62Updated 8 months ago