Alternatives and similar repositories for SWE-bench

Users that are interested in SWE-bench are comparing it to the libraries listed below

• LLMSELECTOR / LLMSELECTOR
  ☆80Updated 4 months ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆117Updated last year
• zou-group / sirius
  SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning
  ☆96Updated 2 months ago
• kolenaIO / autoarena
  Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation
  ☆108Updated last year
• sony / talkhier
  Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"
  ☆60Updated 11 months ago
• sunnweiwei / PPP-Agent
  Training Proactive and Personalized LLM Agents
  ☆100Updated 3 weeks ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆106Updated last year
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 10 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆103Updated 6 months ago
• raphaelmansuy / iteration_of_tought
  Example implementation of Iteration of Tought - Gives a star if you like the project
  ☆41Updated last year
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆132Updated last week
• colonylabs / ScribeAgent
  Code for ScribeAgent paper
  ☆63Updated 11 months ago
• simular-ai / OpenACI
  Open Agent Computer Interface
  ☆92Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆92Updated last year
• AgnostiqHQ / multi-agent-llm
  Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)
  ☆128Updated last year
• samholt / L2MAC
  🚀 The LLM Automatic Computer Framework: L2MAC
  ☆145Updated last year
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆90Updated 2 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆60Updated 10 months ago
• miralab-ai / autoreason
  ☆39Updated last year
• pgasawa / BARE
  Leveraging Base Language Models for Few-Shot Synthetic Data Generation
  ☆40Updated 3 months ago
• THUDM / DeepDive
  DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RL
  ☆281Updated 4 months ago
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆53Updated 5 months ago
• codestoryai / prompts
  Contains the prompts we use to talk to various LLMs for different utilities inside the editor
  ☆84Updated 2 years ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆244Updated last year
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆119Updated 9 months ago
• PathOnAIOrg / LiteMultiAgent
  The Library for LLM-based multi-agent applications
  ☆102Updated 6 months ago
• kagnlp / CodeGenerator
  This repository contains popular code generation frameworks such as MapCoder, CodeSIM.
  ☆69Updated 7 months ago
• JieyuZ2 / EcoAssistant
  EcoAssistant: using LLM assistant more affordably and accurately
  ☆134Updated last year
• metauto-ai / Mindstorm
  🧠 Societies of Mind & Economy of Minds
  ☆74Updated 11 months ago
• qiancheng0 / Open-SMARTAgent
  The official repo for the code and data of paper SMART
  ☆38Updated 11 months ago