Alternatives and similar repositories for stack-eval

Users that are interested in stack-eval are comparing it to the libraries listed below

• neulab / incremental_tree_edit
  Code for "Learning Structural Edits via Incremental Tree Transformations" (ICLR'21)
  ☆41Updated 3 years ago
• SalesforceAIResearch / swecomm
  ☆26Updated 4 months ago
• amazon-science / recode
  Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"
  ☆52Updated last year
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated 2 years ago
• Jun-jie-Huang / CoCLR
  Source Code for ACL-21 main conference paper "CoSQA: 20,000+ Web Queries for Code Search and Question Answering".
  ☆44Updated 2 years ago
• gangiswag / cornstack
  ☆30Updated 2 months ago
• ruyimarone / data-portraits
  Documenting large text datasets 🖼️ 📚
  ☆12Updated 5 months ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆33Updated 6 months ago
• neulab / retomaton
  PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)
  ☆71Updated 2 years ago
• amazon-science / ContraCLM
  [ACL 2023] Code for ContraCLM: Contrastive Learning For Causal Language Model
  ☆33Updated last year
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆22Updated 10 months ago
• rizwan09 / REDCODER
  ☆43Updated 3 months ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆27Updated last year
• logic-star-ai / swt-bench
  [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation
  ☆48Updated last month
• JetBrains-Research / lca-baselines
  Baselines for all tasks from Long Code Arena benchmarks 🏟️
  ☆30Updated last month
• terryyz / ice-score
  [EACL 2024] ICE-Score: Instructing Large Language Models to Evaluate Code
  ☆76Updated 11 months ago
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆62Updated 7 months ago
• psunlpgroup / ReaLMistake
  This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".
  ☆29Updated 9 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 6 months ago
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆57Updated last year
• squaresLab / VarCLR
  VarCLR: Variable Semantic Representation Pre-training via Contrastive Learning
  ☆38Updated 2 years ago
• osainz59 / t5-encoder
  A extension of Transformers library to include T5ForSequenceClassification class.
  ☆38Updated 2 years ago
• shrivastavadisha / repo_level_prompt_generation
  ☆124Updated 2 years ago
• wasiahmad / AVATAR
  Official code of our work, AVATAR: A Parallel Corpus for Java-Python Program Translation.
  ☆54Updated 9 months ago
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆48Updated last year
• benpry / chain-of-thought-metaphor
  This repo contains code for the paper "Psychologically-informed chain-of-thought prompts for metaphor understanding in large language mod…
  ☆14Updated 2 years ago
• crux-eval / eval-arena
  ☆24Updated 6 months ago
• panthap2 / deep-jit-inconsistency-detection
  Deep Just-In-Time Inconsistency Detection Between Comments and Source Code: Artifact
  ☆22Updated 2 years ago
• BrachioLab / incontext_influences
  In-context Example Selection with Influences
  ☆15Updated 2 years ago