swe-bench / SWE-benchLinks
SWE-bench [Multimodal]: Can Language Models Resolve Real-world Github Issues?
☆3,147Updated last week
Alternatives and similar repositories for SWE-bench
Users that are interested in SWE-bench are comparing it to the libraries listed below
Sorting:
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,769Updated 6 months ago
- A project structure aware autonomous software engineer aiming for autonomous program improvement. Resolved 37.3% tasks (pass@1) in SWE-be…☆2,961Updated 2 months ago
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,710Updated 11 months ago
- Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhan…☆1,274Updated last year
- LDB: A Large Language Model Debugger via Verifying Runtime Execution Step by Step (ACL'24)☆547Updated 9 months ago
- AIOS: AI Agent Operating System☆4,330Updated 3 weeks ago
- This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software E…☆1,417Updated last month
- Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""☆3,862Updated 7 months ago
- Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024☆1,499Updated last month
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,231Updated 3 months ago
- Code for the paper "Evaluating Large Language Models Trained on Code"☆2,817Updated 5 months ago
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆2,654Updated 5 months ago
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆7,449Updated this week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,071Updated 10 months ago
- ☆4,084Updated last year
- [ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct☆2,018Updated 8 months ago
- An self-improving embodied conversational agent seamlessly integrated into the operating system to automate our daily tasks.☆1,661Updated 9 months ago
- AIDE: AI-Driven Exploration in the Space of Code. State of the Art machine Learning engineering agents that automates AI R&D.☆944Updated 2 months ago
- AllenAI's post-training codebase☆3,044Updated this week
- Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building age…☆1,237Updated 3 months ago
- [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments☆1,956Updated this week
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆780Updated 2 weeks ago
- ☆3,786Updated last month
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,912Updated 10 months ago
- [ICLR 2025] Automated Design of Agentic Systems☆1,358Updated 5 months ago
- Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆561Updated 3 months ago
- Democratizing Reinforcement Learning for LLMs☆3,600Updated this week
- Tools for merging pretrained large language models.☆5,965Updated 2 weeks ago
- The Open Cookbook for Top-Tier Code Large Language Model☆1,735Updated 6 months ago
- ☆482Updated last week