Alternatives and similar repositories for FullStackBench

Users that are interested in FullStackBench are comparing it to the libraries listed below

• multi-swe-bench / multi-swe-bench
  Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
  ☆249Updated last week
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆256Updated 4 months ago
• open-compass / DevEval
  A Comprehensive Benchmark for Software Development.
  ☆113Updated last year
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆81Updated last year
• YerbaPage / Awesome-Repo-Level-Code-Generation
  Must-read papers on Repository-level Code Generation & Issue Resolution 🔥
  ☆160Updated this week
• LingmaTongyi / Lingma-SWE-GPT
  Inference code of Lingma SWE-GPT
  ☆240Updated 9 months ago
• microsoft / SWE-bench-Live
  🚀 SWE-bench Goes Live!
  ☆119Updated this week
• bytedance / SandboxFusion
  ☆586Updated 2 months ago
• code-rag-bench / code-rag-bench
  CodeRAG-Bench: Can Retrieval Augment Code Generation?
  ☆155Updated 10 months ago
• SparksofAGI / MHPP
  ☆32Updated last week
• RepoUnderstander / RepoUnderstander
  Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)
  ☆94Updated 5 months ago
• amazon-science / cceval
  CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
  ☆156Updated last month
• MCEVAL / McEval
  ☆44Updated 9 months ago
• sail-sg / oat-zero
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.
  ☆244Updated 5 months ago
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆117Updated 5 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆65Updated 9 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆248Updated 10 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆187Updated 2 months ago
• zhenyuhe00 / SWE-Swiss
  SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution
  ☆84Updated this week
• allanj / repo-level-codegen-papers
  Repo-Level Code generation papers
  ☆210Updated 2 months ago
• QiushiSun / Awesome-Code-Intelligence
  Neural Code Intelligence Survey 2024; Reading lists and resources
  ☆268Updated last month
• microsoft / FEA-Bench
  [ACL25] FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation
  ☆25Updated last month
• bigcode-project / bigcodebench
  [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI
  ☆422Updated 2 weeks ago
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆67Updated 11 months ago
• codefuse-ai / codefuse-evaluation
  Industrial-level evaluation benchmarks for Coding LLMs in the full life-cycle of AI native software developing.企业级代码大模型评测体系,持续开放中
  ☆101Updated 4 months ago
• LingmaTongyi / Codev-Bench
  Codev-Bench (Code Development Benchmark), a fine-grained, real-world, repository-level, and developer-centric evaluation framework. Codev…
  ☆49Updated 10 months ago
• GAIR-NLP / ToRL
  ☆287Updated 3 months ago
• SWE-Perf / SWE-Perf
  ☆38Updated last month
• tongye98 / Awesome-Code-Benchmark
  A comprehensive code domain benchmark review of LLM researches.
  ☆102Updated last week
• phonism / CP-Zero
  Based on the R1-Zero method, using rule-based rewards and GRPO on the Code Contests dataset.
  ☆18Updated 5 months ago