openai / code-align-evals-data
☆28Updated 3 years ago
Alternatives and similar repositories for code-align-evals-data:
Users that are interested in code-align-evals-data are comparing it to the libraries listed below
- Code for the TMLR 2023 paper "PPOCoder: Execution-based Code Generation using Deep Reinforcement Learning"☆110Updated last year
- Code for the paper "Efficient Training of Language Models to Fill in the Middle"☆177Updated 2 years ago
- ☆115Updated 9 months ago
- ☆75Updated last month
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆136Updated 6 months ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆86Updated last year
- Accepted by Transactions on Machine Learning Research (TMLR)☆126Updated 6 months ago
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆79Updated 7 months ago
- ☆109Updated 9 months ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆216Updated 11 months ago
- Large Language Models Meet NL2Code: A Survey☆36Updated 5 months ago
- Script for downloading GitHub.☆93Updated 9 months ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆47Updated last year
- ☆63Updated 4 months ago
- ☆36Updated 10 months ago
- A set of utilities for running few-shot prompting experiments on large-language models☆118Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆156Updated 8 months ago
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆59Updated 6 months ago
- A hard gym for programming☆152Updated 9 months ago
- Repository for analysis and experiments in the BigCode project.☆118Updated last year
- Language Models of Code are Few-Shot Commonsense Learners (EMNLP 2022)☆86Updated 2 years ago
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆123Updated 10 months ago
- Scratchpad/Chain-of-Thought Prompts☆12Updated 2 years ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆80Updated 8 months ago
- ☆30Updated last year
- Training language models to make programs faster☆87Updated last year
- Fault-aware neural code rankers☆28Updated 2 years ago
- ☆27Updated last year
- [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆86Updated last year
- ☆148Updated 4 years ago