Alternatives and similar repositories for FullStackBench:

Users that are interested in FullStackBench are comparing it to the libraries listed below

• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆62Updated 7 months ago
• bytedance / SandboxFusion
  ☆121Updated 2 weeks ago
• open-compass / DevEval
  A Comprehensive Benchmark for Software Development.
  ☆93Updated 8 months ago
• LingmaTongyi / Lingma-SWE-GPT
  Inference code of Lingma SWE-GPT
  ☆188Updated 2 months ago
• code-rag-bench / code-rag-bench
  CodeRAG-Bench: Can Retrieval Augment Code Generation?
  ☆109Updated 3 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆57Updated 2 months ago
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆62Updated 4 months ago
• APEXLAB / CodeApex
  ☆48Updated last year
• LingmaTongyi / Codev-Bench
  Codev-Bench (Code Development Benchmark), a fine-grained, real-world, repository-level, and developer-centric evaluation framework. Codev…
  ☆36Updated 3 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆233Updated 3 months ago
• ntunlp / xCodeEval
  xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval
  ☆77Updated 5 months ago
• THUDM / ChatGLM-Math
  ☆81Updated 10 months ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆98Updated 2 months ago
• CodeEditorBench / CodeEditorBench
  ☆43Updated 8 months ago
• InfiAgent / InfiAgent
  InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks (ICML 2024)
  ☆107Updated 2 months ago
• Reason-Wang / ToolGen
  [ICLR 2025] The official implementation of paper "ToolGen: Unified Tool Retrieval and Calling via Generation"
  ☆125Updated 2 months ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆148Updated this week
• QiushiSun / Awesome-Code-Intelligence
  Neural Code Intelligence Survey 2024; Reading lists and resources
  ☆241Updated last week
• amazon-science / Repoformer
  Repoformer: Selective Retrieval for Repository-Level Code Completion (ICML 2024)
  ☆51Updated 7 months ago
• thu-coai / CritiqueLLM
  ☆139Updated 7 months ago
• thu-coai / AutoDetect
  Official github repo for AutoDetect, an automated weakness detection framework for LLMs.
  ☆41Updated 7 months ago
• SparksofAGI / MHPP
  ☆28Updated 3 months ago
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆217Updated this week
• LightChen233 / reasoning-boundary
  ☆45Updated 4 months ago
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆210Updated last month
• RepoUnderstander / RepoUnderstander
  Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)
  ☆71Updated 3 months ago
• scaleapi / plansearch
  e
  ☆22Updated last week
• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆175Updated 4 months ago
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆49Updated last month