Alternatives and similar repositories for devin-swebench-results

Users that are interested in devin-swebench-results are comparing it to the libraries listed below

• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆77Updated last year
• aorwall / moatless-tree-search
  ☆121Updated 5 months ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆219Updated 2 weeks ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆118Updated last year
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆42Updated 2 months ago
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆114Updated 11 months ago
• aorwall / SWE-bench-docker
  ☆101Updated last year
• InternLM / SWE-Fixer
  ☆125Updated 6 months ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆91Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆85Updated 2 years ago
• CarperAI / Code-Pile
  This repository contains all the code for collecting large scale amounts of code from GitHub.
  ☆109Updated 2 years ago
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆134Updated 6 months ago
• princeton-nlp / intercode
  [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
  ☆227Updated last year
• agiresearch / Formal-LLM
  Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents
  ☆128Updated last year
• InflectionAI / Inflection-Benchmarks
  Public Inflection Benchmarks
  ☆68Updated last year
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆92Updated last month
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆42Updated 2 years ago
• PrimeIntellect-ai / genesys
  ☆135Updated 7 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆110Updated last month
• TheDuckAI / DuckTrack
  Multimodal computer agent data collection program
  ☆152Updated last year
• yueqis / API-Based-Agent
  ☆60Updated 4 months ago
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆126Updated 2 years ago
• commit-0 / commit0
  Commit0: Library Generation from Scratch
  ☆171Updated 6 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆102Updated 3 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆109Updated 10 months ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆128Updated 7 months ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆54Updated 6 months ago
• posgnu / rci-agent
  A codebase for "Language Models can Solve Computer Tasks"
  ☆235Updated last year
• aymeric-roucher / GAIA
  Beating the GAIA benchmark with Transformers Agents. 🚀
  ☆138Updated 8 months ago