Alternatives and similar repositories for codebleu

Users that are interested in codebleu are comparing it to the libraries listed below

• FudanSELab / ClassEval
  Benchmark ClassEval for class-level code generation.
  ☆145Updated last year
• allanj / repo-level-codegen-papers
  Repo-Level Code generation papers
  ☆230Updated last month
• CoderEval / CoderEval
  A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.
  ☆155Updated last year
• Intelligent-CAT-Lab / PLTranslationEmpirical
  Artifact repository for the paper "Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code", In P…
  ☆51Updated 9 months ago
• seketeam / EvoCodeBench
  An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
  ☆67Updated last year
• sola-st / crystalbleu
  ☆33Updated 3 years ago
• nju-websoft / DraCo
  Dataflow-guided retrieval augmentation for repository-level code completion, ACL 2024 (main)
  ☆31Updated 9 months ago
• gai4se / LLM4SE
  Large Language Models for Software Engineering
  ☆258Updated 5 months ago
• lin-tan / clm
  For our ICSE23 paper "Impact of Code Language Models on Automated Program Repair" by Nan Jiang, Kevin Liu, Thibaud Lutellier, and Lin Tan
  ☆63Updated last year
• reddy-lab-code-research / XLCoST
  Code and data for XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence
  ☆90Updated 11 months ago
• iSEngLab / AwesomeLLM4APR
  A Systematic Literature Review on Large Language Models for Automated Program Repair
  ☆222Updated last week
• iSEngLab / AwesomeLearningAPR
  [TOSEM 2023] A Survey of Learning-based Automated Program Repair
  ☆73Updated last year
• GhabiX / SRepair
  ✅SRepair: Powerful LLM-based Program Repairer with $0.029/Fixed Bug
  ☆72Updated last year
• iSEngLab / LLM4UT_Empirical
  [ISSTA 2025] A Large-scale Empirical Study on Fine-tuning Large Language Models for Unit Testing
  ☆13Updated 11 months ago
• amazon-science / cocomic
  CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
  ☆18Updated last week
• afortunado-aceptado / Rudra
  This repo is for our submission for ICSE 2025.
  ☆20Updated last year
• ZZR0 / ISSTA22-CodeStudy
  This repo illustrates how to evaluate the artifacts in the paper An Extensive Study on Pre-trained Models for Program Understanding and G…
  ☆26Updated 3 years ago
• floatai / HumanEval-XL
  [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization
  ☆40Updated 10 months ago
• seketeam / DevEval
  A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories
  ☆35Updated last year
• shangqing-liu / ContraBERT
  Enhacing Code Pre-trained Models by Contrastive Learning
  ☆38Updated 2 years ago
• jiangyanjie / Deep-Learning-Based-Software-Engineering
  ☆24Updated last year
• ComplexCodeEval / ComplexCodeEval
  ☆21Updated last year
• thunlp / DebugBench
  The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".
  ☆85Updated last year
• oceaneLIU / GraphCoder
  ☆57Updated last year
• BuiltOntheRock / FSE22_BuiltOntheRock
  ☆26Updated 3 years ago
• ZJU-ACES-ISE / ChatUniTest
  ☆163Updated 5 months ago
• amazon-science / cceval
  CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
  ☆167Updated 5 months ago
• sola-st / ExecutionAgent
  LLM agent to automatically set up arbitrary projects and run their test suites
  ☆57Updated 6 months ago
• iCSawyer / SEConfPaperList
  List of research papers of ICSE, FSE, ASE, and ISSTA since 2020.
  ☆33Updated 3 months ago
• evo-eval / evoeval
  EvoEval: Evolving Coding Benchmarks via LLM
  ☆80Updated last year