bigcode-project / bigcode-dataset
☆419Updated 6 months ago
Alternatives and similar repositories for bigcode-dataset:
Users that are interested in bigcode-dataset are comparing it to the libraries listed below
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆451Updated 2 weeks ago
- Repository for analysis and experiments in the BigCode project.☆117Updated 11 months ago
- A multi-programming language benchmark for LLMs☆227Updated 3 weeks ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆233Updated 3 months ago
- A framework for the evaluation of autoregressive code generation language models.☆886Updated 3 months ago
- Code for the curation of The Stack v2 and StarCoder2 training data☆96Updated 10 months ago
- ☆628Updated 3 months ago
- Open Source WizardCoder Dataset☆156Updated last year
- ☆268Updated last year
- Run evaluation on LLMs using human-eval benchmark☆395Updated last year
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆541Updated 11 months ago
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆307Updated last year
- Data and code for "DocPrompting: Generating Code by Retrieving the Docs" @ICLR 2023☆238Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆130Updated 6 months ago
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆370Updated 7 months ago
- Scaling Data-Constrained Language Models☆333Updated 5 months ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆451Updated 11 months ago
- Accepted by Transactions on Machine Learning Research (TMLR)☆124Updated 4 months ago
- All available datasets for Instruction Tuning of Large Language Models☆242Updated last year
- Expanding natural instructions☆975Updated last year
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467☆277Updated last week
- DSIR large-scale data selection framework for language model training☆241Updated 10 months ago
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆913Updated 3 months ago
- CodeBERTScore: an automatic metric for code generation, based on BERTScore☆183Updated 11 months ago
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆459Updated 7 months ago
- ☆352Updated last year
- Fine-tune SantaCoder for Code/Text Generation.☆188Updated last year
- ☆496Updated 3 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆312Updated last year
- ☆105Updated 7 months ago