Alternatives and similar repositories for FullStackBench:

Users that are interested in FullStackBench are comparing it to the libraries listed below

• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆179Updated this week
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆72Updated 9 months ago
• bytedance / SandboxFusion
  ☆232Updated 2 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆131Updated 3 weeks ago
• multi-swe-bench / multi-swe-bench
  Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
  ☆128Updated last week
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆63Updated 6 months ago
• open-compass / DevEval
  A Comprehensive Benchmark for Software Development.
  ☆102Updated 10 months ago
• MCEVAL / McEval
  ☆39Updated 4 months ago
• HIT-SCIR / Abacus
  珠算代码大模型（Abacus Code LLM）
  ☆56Updated 7 months ago
• sail-sg / oat-zero
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.
  ☆229Updated last week
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆240Updated 5 months ago
• LingmaTongyi / Codev-Bench
  Codev-Bench (Code Development Benchmark), a fine-grained, real-world, repository-level, and developer-centric evaluation framework. Codev…
  ☆41Updated 5 months ago
• LingmaTongyi / Lingma-SWE-GPT
  Inference code of Lingma SWE-GPT
  ☆213Updated 4 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆63Updated 5 months ago
• SuperGPQA / SuperGPQA
  ☆146Updated last month
• floatai / HumanEval-XL
  [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization
  ☆39Updated last month
• FateScript / token_visualizer
  Token level visualization tools for large language models
  ☆79Updated 3 months ago
• code-rag-bench / code-rag-bench
  CodeRAG-Bench: Can Retrieval Augment Code Generation?
  ☆128Updated 5 months ago
• MilkThink-Lab / RouterEval
  A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in Large Language Models
  ☆38Updated last month
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆187Updated 2 months ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆101Updated 4 months ago
• THUDM / ChatGLM-Math
  ☆81Updated last year
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆236Updated last week
• QiushiSun / Awesome-Code-Intelligence
  Neural Code Intelligence Survey 2024; Reading lists and resources
  ☆259Updated last month
• microsoft / WaveCoder
  Advancing LLM with Diverse Coding Capabilities
  ☆69Updated 9 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆75Updated last week
• yanweiyue / masrouter
  ☆52Updated 2 months ago
• OpenMOSS / Thus-Spake-Long-Context-LLM
  a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation
  ☆46Updated 3 weeks ago
• inclusionAI / Ling
  Ling is a MoE LLM provided and open-sourced by InclusionAI.
  ☆143Updated last week
• codefuse-ai / CodeFuse-CGE
  ☆19Updated 4 months ago