Alternatives and similar repositories for devin-swebench-results

Users that are interested in devin-swebench-results are comparing it to the libraries listed below

• Aider-AI / aider-swe-bench
  Harness used to benchmark aider against SWE Bench benchmarks
  ☆78Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆111Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆85Updated 2 years ago
• asappresearch / webagents-step
  ☆41Updated last year
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆102Updated 4 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆93Updated last year
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆43Updated 2 years ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆55Updated 8 months ago
• SWE-bench / sb-cli
  Run SWE-bench evaluations remotely
  ☆47Updated 4 months ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated last year
• aorwall / moatless-tree-search
  ☆128Updated 6 months ago
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆126Updated 2 years ago
• posgnu / rci-agent
  A codebase for "Language Models can Solve Computer Tasks"
  ☆239Updated last year
• InflectionAI / Inflection-Benchmarks
  Public Inflection Benchmarks
  ☆68Updated last year
• Anni-Zou / Meta-CoT
  Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models
  ☆100Updated 2 years ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆66Updated last year
• CarperAI / Code-Pile
  This repository contains all the code for collecting large scale amounts of code from GitHub.
  ☆110Updated 2 years ago
• Ag2S1 / Sibyl-System
  ☆126Updated last year
• InternLM / SWE-Fixer
  ☆130Updated 7 months ago
• allenai / recoma
  Reasoning by Communicating with Agents
  ☆29Updated 7 months ago
• GammaTauAI / leetcode-hard-gym
  A hard gym for programming
  ☆163Updated last year
• All-Hands-AI / openhands-resolver
  A system that tries to resolve all issues on a github repo with OpenHands.
  ☆117Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆66Updated 2 years ago
• TheDuckAI / DuckTrack
  Multimodal computer agent data collection program
  ☆153Updated 3 weeks ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆118Updated 7 months ago
• aorwall / SWE-bench-docker
  ☆102Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆107Updated 3 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆118Updated 2 months ago
• AutoLLM / AutoAgents
  Complex question answering in LLMs with enhanced reasoning and information-seeking capabilities.
  ☆204Updated 2 years ago