Alternatives and similar repositories for devin-swebench-results

Users that are interested in devin-swebench-results are comparing it to the libraries listed below

• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆72Updated last year
• aorwall / moatless-tree-search
  ☆100Updated 2 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆201Updated 3 weeks ago
• CarperAI / Code-Pile
  This repository contains all the code for collecting large scale amounts of code from GitHub.
  ☆110Updated 2 years ago
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆85Updated last year
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆34Updated last week
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆105Updated 7 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆97Updated this week
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆99Updated 3 months ago
• aorwall / SWE-bench-docker
  ☆100Updated last year
• Eureka6174 / LearnNLPlan
  Learning to Program with Natural Language
  ☆6Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated last year
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆131Updated 5 months ago
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆161Updated 3 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆59Updated 8 months ago
• InternLM / SWE-Fixer
  ☆109Updated 3 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆58Updated 3 months ago
• NL2Code / CodeR
  ☆159Updated 11 months ago
• Ag2S1 / Sibyl-System
  ☆123Updated 11 months ago
• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆223Updated last year
• asappresearch / webagents-step
  ☆41Updated last year
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆122Updated last year
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆29Updated 3 months ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆96Updated 10 months ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆87Updated 10 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆99Updated this week
• posgnu / rci-agent
  A codebase for "Language Models can Solve Computer Tasks"
  ☆234Updated last year
• Zyq-scut / RLTF
  Accepted by Transactions on Machine Learning Research (TMLR)
  ☆130Updated 10 months ago
• TheDuckAI / DuckTrack
  Multimodal computer agent data collection program
  ☆141Updated last year