Alternatives and similar repositories for stack-eval

Users that are interested in stack-eval are comparing it to the libraries listed below

• shrivastavadisha / repo_level_prompt_generation
  ☆126Updated 2 years ago
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆49Updated last year
• ntunlp / ExecEval
  A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.
  ☆56Updated 11 months ago
• niansong1996 / lever
  Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)
  ☆90Updated 2 years ago
• gangiswag / cornstack
  ☆40Updated 3 months ago
• amazon-science / recode
  Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"
  ☆52Updated last year
• rajasagashe / JuICe
  Code for generating the JuICe dataset.
  ☆37Updated 3 years ago
• logic-star-ai / swt-bench
  [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation
  ☆56Updated 3 weeks ago
• nyu-mll / ILF-for-code-generation
  ☆78Updated 6 months ago
• terryyz / ice-score
  [EACL 2024] ICE-Score: Instructing Large Language Models to Evaluate Code
  ☆79Updated last year
• reasoning-machines / CoCoGen
  Language Models of Code are Few-Shot Commonsense Learners (EMNLP 2022)
  ☆85Updated 2 years ago
• shuyanzhou / docprompting
  Data and code for "DocPrompting: Generating Code by Retrieving the Docs" @ICLR 2023
  ☆249Updated last year
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)
  ☆71Updated last year
• amazon-science / mxeval
  ☆111Updated last year
• rmshin / llm-mcts
  ☆41Updated last year
• ntunlp / xCodeEval
  xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval
  ☆86Updated last year
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆62Updated last year
• jadecxliu / CodeQA
  Dataset and code for Findings of EMNLP'21 paper "CodeQA: A Question Answering Dataset for Source Code Comprehension".
  ☆42Updated last year
• JetBrains-Research / lca-baselines
  Baselines for all tasks from Long Code Arena benchmarks 🏟️
  ☆35Updated 6 months ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 2 years ago
• jlin816 / dialop
  DialOp: Decision-oriented dialogue environments for collaborative language agents
  ☆110Updated 10 months ago
• reddy-lab-code-research / PPOCoder
  Code for the TMLR 2023 paper "PPOCoder: Execution-based Code Generation using Deep Reinforcement Learning"
  ☆115Updated last year
• wasiahmad / AVATAR
  Official code of our work, AVATAR: A Parallel Corpus for Java-Python Program Translation.
  ☆58Updated last year
• austrian-code-wizard / c3po
  ☆29Updated 2 months ago
• Ablustrund / APPS_Plus
  StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback
  ☆71Updated last year
• xingyaoww / LeTI
  Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."
  ☆64Updated 2 years ago
• shunzh / Code-AI-Tree-Search
  ☆119Updated last year
• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆36Updated 10 months ago
• rizwan09 / REDCODER
  ☆45Updated 3 months ago
• theblackcat102 / evol-dataset
  evol augment any dataset online
  ☆60Updated 2 years ago