Alternatives and similar repositories for FullStackBench:

Users that are interested in FullStackBench are comparing it to the libraries listed below

• bytedance / SandboxFusion
  ☆173Updated last month
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆68Updated 8 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆86Updated 2 weeks ago
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆140Updated 3 weeks ago
• sail-sg / oat-zero
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.
  ☆216Updated this week
• LingmaTongyi / Lingma-SWE-GPT
  Inference code of Lingma SWE-GPT
  ☆199Updated 3 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆237Updated 5 months ago
• open-compass / DevEval
  A Comprehensive Benchmark for Software Development.
  ☆100Updated 10 months ago
• APEXLAB / CodeApex
  ☆49Updated last year
• vyokky / LLM-Brained-GUI-Agents-Survey
  GitHub page for "Large Language Model-Brained GUI Agents: A Survey"
  ☆136Updated 3 weeks ago
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆229Updated last month
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆62Updated 5 months ago
• thu-coai / CritiqueLLM
  ☆142Updated 8 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆60Updated 4 months ago
• SuperGPQA / SuperGPQA
  ☆124Updated 3 weeks ago
• zjunlp / WorfBench
  [ICLR 2025] Benchmarking Agentic Workflow Generation
  ☆63Updated last month
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆102Updated 3 months ago
• thinkwee / iAgents
  connecting humans and agents
  ☆80Updated 3 months ago
• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆179Updated 5 months ago
• ADaM-BJTU / AutoCoA
  AutoCoA (Automatic generation of Chain-of-Action) is an agent model framework that enhances the multi-turn tool usage capability of reaso…
  ☆75Updated last week
• HqWu-HITCS / Awesome-Personalized-LLM
  This repo aims to record resource of role-playing abilities in LLMs, including dataset, paper, application, etc.
  ☆107Updated 6 months ago
• cavalierlulu / rag_survey
  ☆122Updated last year
• InfiAgent / InfiAgent
  InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks (ICML 2024)
  ☆113Updated 3 months ago
• QiushiSun / Awesome-Code-Intelligence
  Neural Code Intelligence Survey 2024; Reading lists and resources
  ☆257Updated last week
• bytarnish / AGILE
  ☆113Updated 2 months ago
• SparksofAGI / MHPP
  ☆28Updated 4 months ago
• code-rag-bench / code-rag-bench
  CodeRAG-Bench: Can Retrieval Augment Code Generation?
  ☆119Updated 4 months ago
• TemporaryLoRA / Temp-LoRA
  ☆101Updated 11 months ago
• amazon-science / cceval
  CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
  ☆136Updated 8 months ago
• RepoUnderstander / RepoUnderstander
  Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)
  ☆74Updated this week