Alternatives and similar repositories for devin-swebench-results

Users that are interested in devin-swebench-results are comparing it to the libraries listed below

• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆191Updated this week
• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆72Updated last year
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆88Updated 2 weeks ago
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆27Updated 2 weeks ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆110Updated 7 months ago
• asappresearch / webagents-step
  ☆40Updated 11 months ago
• aorwall / moatless-tree-search
  ☆93Updated last month
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆98Updated 8 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 11 months ago
• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆221Updated last year
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆58Updated 7 months ago
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆122Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆65Updated 2 years ago
• kyegomez / Algorithm-Of-Thoughts
  My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"
  ☆98Updated last year
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆242Updated last week
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆106Updated 7 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆113Updated 10 months ago
• McGill-NLP / weblinx
  WebLINX is a benchmark for building web navigation agents with conversational capabilities
  ☆153Updated 5 months ago
• Ag2S1 / Sibyl-System
  ☆122Updated 11 months ago
• posgnu / rci-agent
  A codebase for "Language Models can Solve Computer Tasks"
  ☆233Updated last year
• agiresearch / Formal-LLM
  Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents
  ☆124Updated last year
• SWE-bench / SWE-smith
  Scaling Data for SWE-agents
  ☆293Updated this week
• NL2Code / CodeR
  ☆158Updated 10 months ago
• r2e-project / r2e
  r2e: turn any github repository into a programming agent environment
  ☆126Updated 2 months ago
• TheDuckAI / DuckTrack
  Multimodal computer agent data collection program
  ☆140Updated last year
• aorwall / SWE-bench-docker
  ☆99Updated 11 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆97Updated 2 months ago
• MurtyShikhar / NNetnav
  Interaction-first method for generating demonstrations for web-agents on any website
  ☆41Updated 2 months ago
• yueqis / API-Based-Agent
  ☆50Updated 2 weeks ago
• young-geng / koala_data_pipeline
  The data processing pipeline for the Koala chatbot language model
  ☆117Updated 2 years ago