☆489Aug 15, 2024Updated last year
Alternatives and similar repositories for bigcode-dataset
Users that are interested in bigcode-dataset are comparing it to the libraries listed below
Sorting:
- Repository for analysis and experiments in the BigCode project.☆128Mar 20, 2024Updated last year
- Code for the curation of The Stack v2 and StarCoder2 training data☆126Apr 11, 2024Updated last year
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆318Mar 20, 2023Updated 2 years ago
- A framework for the evaluation of autoregressive code generation language models.☆1,020Jul 22, 2025Updated 7 months ago
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆478Feb 5, 2025Updated last year
- All-in-one text de-duplication☆744Jan 2, 2026Updated last month
- Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024☆1,688Oct 2, 2025Updated 4 months ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆174Aug 15, 2025Updated 6 months ago
- Scaling Data-Constrained Language Models☆340Jun 28, 2025Updated 8 months ago
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆63Apr 10, 2024Updated last year
- ☆1,257Jul 30, 2024Updated last year
- Code for the paper "Efficient Training of Language Models to Fill in the Middle"☆199Apr 2, 2023Updated 2 years ago
- ☆32Jul 24, 2023Updated 2 years ago
- ☆566Nov 20, 2024Updated last year
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,923Dec 7, 2024Updated last year
- A multi-programming language benchmark for LLMs☆298Jan 28, 2026Updated 3 weeks ago
- ☆1,504May 12, 2023Updated 2 years ago
- ☆15Oct 24, 2023Updated 2 years ago
- Home of StarCoder: fine-tuning & inference!☆7,530Feb 27, 2024Updated 2 years ago
- [ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct☆2,076Nov 1, 2024Updated last year
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,903Updated this week
- Ongoing research training transformer models at scale☆395Aug 20, 2024Updated last year
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,476Jun 7, 2025Updated 8 months ago
- Code for the paper "Evaluating Large Language Models Trained on Code"☆3,137Jan 17, 2025Updated last year
- This is the official code for the paper CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning (Neur…☆558Jan 21, 2025Updated last year
- ☆979Feb 7, 2025Updated last year
- Fine-tune SantaCoder for Code/Text Generation.☆196Apr 11, 2023Updated 2 years ago
- Heuristic filtering framework for RefineCode☆82Mar 13, 2025Updated 11 months ago
- Data and tools for generating and inspecting OLMo pre-training data.☆1,411Nov 5, 2025Updated 3 months ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,816Jun 17, 2025Updated 8 months ago
- 800,000 step-level correctness labels on LLM solutions to MATH problems☆2,091Jun 1, 2023Updated 2 years ago
- Tools to download and cleanup Common Crawl data☆1,039Apr 25, 2023Updated 2 years ago
- DeepSeek Coder: Let the Code Write Itself☆22,833Nov 11, 2025Updated 3 months ago
- CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.☆5,169Oct 27, 2025Updated 4 months ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆166Oct 11, 2024Updated last year
- Open Academic Research on Improving LLaMA to SOTA LLM☆1,611Aug 30, 2023Updated 2 years ago
- Home of CodeT5: Open Code LLMs for Code Understanding and Generation☆3,097Jan 20, 2024Updated 2 years ago
- Generative model for code infilling and synthesis☆315Sep 9, 2023Updated 2 years ago
- Open Source WizardCoder Dataset☆164Jul 12, 2023Updated 2 years ago