bigcode-project / bigcodebench-annotation
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
☆19Updated 6 months ago
Alternatives and similar repositories for bigcodebench-annotation:
Users that are interested in bigcodebench-annotation are comparing it to the libraries listed below
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆57Updated 4 months ago
- Training and Benchmarking LLMs for Code Preference.☆31Updated 3 months ago
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆57Updated 10 months ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆77Updated 6 months ago
- ☆53Updated last year
- ☆24Updated last month
- GenRM-CoT: Data release for verification rationales☆46Updated 4 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆130Updated 4 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated 11 months ago
- ☆93Updated last year
- official repo for the paper "Learning From Mistakes Makes LLM Better Reasoner"☆59Updated last year
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆72Updated 8 months ago
- ☆22Updated 3 months ago
- [EMNLP Findings 2024 & ACL 2024 NLRSE Oral] Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards☆48Updated 9 months ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆83Updated last year
- ☆33Updated last year
- Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"☆29Updated 8 months ago
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆119Updated 7 months ago
- Directional Preference Alignment☆56Updated 4 months ago
- [ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks☆52Updated last year
- [ICML 2024] Self-Infilling Code Generation☆18Updated 9 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆115Updated 5 months ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆42Updated 6 months ago
- ☆43Updated 8 months ago
- ☆39Updated 6 months ago
- ☆82Updated 4 months ago
- This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"☆45Updated 3 months ago
- [ICML'24] TroVE: Inducing Verifiable and Efficient Toolboxes for Solving Programmatic Tasks☆23Updated 4 months ago