Alternatives and similar repositories for bigcodearena

Users that are interested in bigcodearena are comparing it to the libraries listed below

• THUDM / SWE-Dev
  [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.
  ☆56Updated 4 months ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆102Updated last year
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆19Updated last year
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆44Updated 3 months ago
• thunlp / Optima
  Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"
  ☆67Updated last year
• hkust-nlp / Toolathlon
  The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution
  ☆171Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 9 months ago
• yueqis / API-Based-Agent
  ☆63Updated 5 months ago
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆35Updated 5 months ago
• OSU-NLP-Group / Mind2Web-2
  [NeurIPS'25 D&B] Mind2Web-2 Benchmark: Evaluating Agentic Search with Agent-as-a-Judge
  ☆93Updated 2 weeks ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆84Updated 8 months ago
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆94Updated 6 months ago
• xlang-ai / computer-agent-arena
  Computer Agent Arena: Test & compare AI agents in real desktop apps & web environments. Code/data coming soon!
  ☆51Updated 8 months ago
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆115Updated 6 months ago
• convergence-ai / webgames
  Challenges for general-purpose web-browsing AI agents
  ☆67Updated 6 months ago
• gso-bench / gso
  [NeurIPS '25] Challenging Software Optimization Tasks for Evaluating SWE-Agents
  ☆58Updated last week
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆66Updated last year
• zorazrw / agent-skill-induction
  Agent Skill Induction: "Inducing Programmatic Skills for Agentic Tasks"
  ☆31Updated 7 months ago
• sunblaze-ucb / AgentSynth
  AgentSynth: Scalable Task Generation for Generalist Computer-Use Agents
  ☆34Updated 2 months ago
• aorwall / moatless-testbeds
  Moatless Testbeds allows you to create isolated testbed environments in a Kubernetes cluster where you can apply code changes through git…
  ☆14Updated 8 months ago
• aorwall / moatless-tree-search
  ☆126Updated 6 months ago
• zhenyuhe00 / SWE-Swiss
  SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution
  ☆98Updated 2 months ago
• MLE-Dojo / MLE-Dojo
  ☆84Updated last month
• HyperPotatoNeo / RSA
  ☆77Updated 2 months ago
• sunblaze-ucb / reasoning_ladder
  ☆35Updated 6 months ago
• SalesforceAIResearch / swecomm
  ☆28Updated last month
• xlang-ai / Spider2-V
  [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?
  ☆135Updated last year
• adityasoni9998 / OpenHands-Versa
  Code for the paper "Coding Agents with Multimodal Browsing are Generalist Problem Solvers"
  ☆93Updated last month
• dxhou / CoAct
  ☆32Updated last year
• agential-ai / agential
  🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!
  ☆54Updated 5 months ago