Alternatives and similar repositories for FullStackBench

Users that are interested in FullStackBench are comparing it to the libraries listed below

• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆208Updated last month
• open-compass / DevEval
  A Comprehensive Benchmark for Software Development.
  ☆106Updated last year
• TIGER-AI-Lab / AceCoder
  The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]
  ☆86Updated last month
• LingmaTongyi / Lingma-SWE-GPT
  Inference code of Lingma SWE-GPT
  ☆221Updated 6 months ago
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆77Updated 10 months ago
• multi-swe-bench / multi-swe-bench
  Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
  ☆181Updated this week
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆147Updated this week
• code-rag-bench / code-rag-bench
  CodeRAG-Bench: Can Retrieval Augment Code Generation?
  ☆138Updated 6 months ago
• bytedance / SandboxFusion
  ☆362Updated this week
• yuzhu-cai / rSDE-Bench
  ☆21Updated last week
• microsoft / WaveCoder
  Advancing LLM with Diverse Coding Capabilities
  ☆72Updated 10 months ago
• LingmaTongyi / Codev-Bench
  Codev-Bench (Code Development Benchmark), a fine-grained, real-world, repository-level, and developer-centric evaluation framework. Codev…
  ☆42Updated 7 months ago
• YerbaPage / Awesome-Repo-Level-Code-Generation
  Must-read papers on Repository-level Code Generation & Issue Resolution 🔥
  ☆89Updated this week
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆65Updated 7 months ago
• amazon-science / cceval
  CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
  ☆143Updated 10 months ago
• SparksofAGI / MHPP
  ☆31Updated 2 weeks ago
• MCEVAL / McEval
  ☆40Updated 5 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆243Updated 7 months ago
• sail-sg / oat-zero
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.
  ☆239Updated last month
• RepoUnderstander / RepoUnderstander
  Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)
  ☆85Updated 2 months ago
• APEXLAB / CodeApex
  ☆49Updated last year
• codefuse-ai / CodeFuse-CGE
  ☆20Updated last month
• DeepSoftwareAnalytics / RLCoder
  Reinforcement Learning for Repository-Level Code Completion
  ☆33Updated 9 months ago
• seketeam / EvoCodeBench
  An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
  ☆60Updated 9 months ago
• floatai / HumanEval-XL
  [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization
  ☆39Updated 3 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆63Updated 6 months ago
• CodeEditorBench / CodeEditorBench
  ☆46Updated last year
• InfiAgent / InfiAgent
  InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks (ICML 2024)
  ☆132Updated last week
• thu-coai / AutoDetect
  Official github repo for AutoDetect, an automated weakness detection framework for LLMs.
  ☆42Updated 11 months ago
• SuperGPQA / SuperGPQA
  ☆151Updated last month