bigcode-project / bigcode-datasetLinks
☆472Updated last year
Alternatives and similar repositories for bigcode-dataset
Users that are interested in bigcode-dataset are comparing it to the libraries listed below
Sorting:
- A framework for the evaluation of autoregressive code generation language models.☆981Updated 2 months ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆256Updated 11 months ago
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆472Updated 8 months ago
- Run evaluation on LLMs using human-eval benchmark☆420Updated 2 years ago
- A multi-programming language benchmark for LLMs☆276Updated last month
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆547Updated last year
- Open Source WizardCoder Dataset☆161Updated 2 years ago
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆515Updated last year
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆314Updated 2 years ago
- ☆275Updated 2 years ago
- Code for the curation of The Stack v2 and StarCoder2 training data☆116Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆171Updated last year
- ☆763Updated last year
- ☆667Updated 11 months ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆157Updated last month
- Repository for analysis and experiments in the BigCode project.☆124Updated last year
- Official repository for LongChat and LongEval☆533Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆473Updated last year
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆389Updated last year
- ☆541Updated 10 months ago
- PaL: Program-Aided Language Models (ICML 2023)☆511Updated 2 years ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆670Updated 2 months ago
- Ongoing research training transformer models at scale☆391Updated last year
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆430Updated last month
- Fine-tune SantaCoder for Code/Text Generation.☆195Updated 2 years ago
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆570Updated 9 months ago
- distributed trainer for LLMs☆580Updated last year
- CodeBERTScore: an automatic metric for code generation, based on BERTScore☆199Updated last year
- Generative Representational Instruction Tuning☆674Updated 3 months ago
- Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718☆349Updated last year