bigcode-project / bigcode-datasetLinks
β475Updated last year
Alternatives and similar repositories for bigcode-dataset
Users that are interested in bigcode-dataset are comparing it to the libraries listed below
Sorting:
- A framework for the evaluation of autoregressive code generation language models.β986Updated 3 months ago
- π OctoPack: Instruction Tuning Code Large Language Modelsβ471Updated 8 months ago
- Run evaluation on LLMs using human-eval benchmarkβ420Updated 2 years ago
- β668Updated 11 months ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".β256Updated 11 months ago
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.β548Updated last year
- Code for the curation of The Stack v2 and StarCoder2 training dataβ117Updated last year
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmarkβ390Updated last year
- Open Source WizardCoder Datasetβ160Updated 2 years ago
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themβ519Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)β159Updated 2 months ago
- A multi-programming language benchmark for LLMsβ278Updated 2 months ago
- Official repository for LongChat and LongEvalβ531Updated last year
- β274Updated 2 years ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Contextβ477Updated last year
- β¨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024β174Updated last year
- β767Updated last year
- Repository for analysis and experiments in the BigCode project.β124Updated last year
- distributed trainer for LLMsβ581Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]β572Updated 10 months ago
- Codes for the paper "βBench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718β352Updated last year
- Code used for sourcing and cleaning the BigScience ROOTS corpusβ316Updated 2 years ago
- β544Updated 11 months ago
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGIβ440Updated last week
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"β688Updated 3 months ago
- Code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning" [ICLR 2024]β377Updated last year
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasetsβ342Updated last year
- A large-scale, fine-grained, diverse preference dataset (and models).β352Updated last year
- β111Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"β360Updated last year