Alternatives and similar repositories for coderec_programming_states

Users that are interested in coderec_programming_states are comparing it to the libraries listed below

• logic-star-ai / swt-bench
  [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation
  ☆66Updated 3 weeks ago
• shrivastavadisha / repo_level_prompt_generation
  ☆127Updated 2 years ago
• amazon-science / recode
  Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"
  ☆57Updated last year
• nuprl / CanItEdit
  Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions
  ☆48Updated 3 months ago
• codetlingua / codetlingua
  ☆18Updated last year
• amazon-science / mxeval
  ☆112Updated last year
• shuyanzhou / docprompting
  Data and code for "DocPrompting: Generating Code by Retrieving the Docs" @ICLR 2023
  ☆251Updated 2 years ago
• Intelligent-CAT-Lab / CodeMind
  CodeMind is a generic framework for evaluating inductive code reasoning of LLMs. It is equipped with a static analysis component that ena…
  ☆42Updated last month
• evo-eval / evoeval
  EvoEval: Evolving Coding Benchmarks via LLM
  ☆80Updated last year
• IBM / TDD-Bench-Verified
  TDD-Bench-Verified is a new benchmark for generating test cases for test-driven development (TDD)
  ☆25Updated 3 months ago
• neulab / code-bert-score
  CodeBERTScore: an automatic metric for code generation, based on BERTScore
  ☆206Updated last year
• gonglinyuan / ast_t5
  ☆79Updated last year
• terryyz / DataAug4Code
  Source Code Data Augmentation for Deep Learning: A Survey.
  ☆66Updated last year
• amazon-science / CodeSage
  CodeSage: Code Representation Learning At Scale (ICLR 2024)
  ☆115Updated last year
• microsoft / coverage-eval
  Dataset with coverage annotations for HumanEval dataset
  ☆24Updated 2 years ago
• Leolty / repobench
  ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024
  ☆184Updated last year
• FudanSELab / codegen4libs
  repo for the paper titled “CodeGen4Libs: A Two-Stage Approach for Library-Oriented Code Generation”
  ☆14Updated 2 years ago
• microsoft / CodePlan
  Data and evaluation scripts for "CodePlan: Repository-level Coding using LLMs and Planning", FSE 2024
  ☆79Updated last year
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆138Updated 8 months ago
• 9erxis / DietCode
  ☆20Updated 2 years ago
• bdqnghi / awesome-ai4code
  A collection of recent papers, benchmarks and datasets of AI4Code domain.
  ☆58Updated last year
• gai4se / GAI4SE-Course
  ☆24Updated last month
• DeepSoftwareAnalytics / CommitMsgEmpirical
  ☆30Updated 2 years ago
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆49Updated 2 years ago
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆128Updated last year
• tech-srl / c3po
  Code for the paper "A Structural Model for Contextual Code Changes"
  ☆32Updated 2 years ago
• SWE-bench / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆233Updated this week
• SalesforceAIResearch / CodeChain
  Official code for the paper "CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules"
  ☆48Updated 2 months ago
• terryyz / ice-score
  [EACL 2024] ICE-Score: Instructing Large Language Models to Evaluate Code
  ☆80Updated last year
• cedricrupb / code_tokenize
  Fast tokenization and structural analysis of any programming language
  ☆61Updated 11 months ago