Alternatives and similar repositories for Awesome-Code-Benchmark

Users that are interested in Awesome-Code-Benchmark are comparing it to the libraries listed below

• YerbaPage / Awesome-Repo-Level-Code-Generation
  Must-read papers on Repository-level Code Generation & Issue Resolution 🔥
  ☆98Updated last week
• amazon-science / Repoformer
  Repoformer: Selective Retrieval for Repository-Level Code Completion (ICML 2024)
  ☆55Updated this week
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆114Updated 11 months ago
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆99Updated 10 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆91Updated 8 months ago
• GeniusHTX / TALE
  ☆116Updated last month
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆81Updated 10 months ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆59Updated 6 months ago
• princeton-pli / LongProc
  LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
  ☆26Updated last month
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆114Updated 5 months ago
• floatai / HumanEval-XL
  [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization
  ☆39Updated 3 months ago
• ntunlp / ExecEval
  A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.
  ☆55Updated 8 months ago
• open-compass / DevEval
  A Comprehensive Benchmark for Software Development.
  ☆108Updated last year
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆151Updated 2 weeks ago
• NEUIR / COAST
  Official repository for the paper "COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis".
  ☆13Updated 4 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆57Updated 8 months ago
• CodeEditorBench / CodeEditorBench
  ☆46Updated last year
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆66Updated 8 months ago
• getao / icae
  The repo for In-context Autoencoder
  ☆128Updated last year
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆98Updated last month
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆77Updated 11 months ago
• halfrot / ALaRM
  [ACL 2024] Code for the paper "ALaRM: Align Language Models via Hierarchical Rewards Modeling"
  ☆25Updated last year
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆65Updated 8 months ago
• TIGER-AI-Lab / AceCoder
  The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]
  ☆85Updated 2 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆125Updated last year
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆141Updated last month
• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆158Updated last month
• zhangxjohn / LLM-Agent-Benchmark-List
  A banchmark list for evaluation of large language models.
  ☆127Updated last month
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆58Updated last year
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆63Updated 8 months ago