bigcode-project / bigcode-analysis
Repository for analysis and experiments in the BigCode project.
☆115Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for bigcode-analysis
- Code for the curation of The Stack v2 and StarCoder2 training data☆90Updated 7 months ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆76Updated 11 months ago
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆206Updated 10 months ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆141Updated 6 months ago
- ☆29Updated last year
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆213Updated last year
- Scaling Data-Constrained Language Models☆321Updated last month
- Multipack distributed sampler for fast padding-free training of LLMs☆178Updated 3 months ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆177Updated 2 years ago
- ☆118Updated 6 months ago
- Open Source WizardCoder Dataset☆153Updated last year
- DSIR large-scale data selection framework for language model training☆230Updated 7 months ago
- A framework for few-shot evaluation of autoregressive language models.☆101Updated last year
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆190Updated this week
- ☆366Updated 3 months ago
- Accepted by Transactions on Machine Learning Research (TMLR)☆119Updated last month
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆133Updated 3 months ago
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆213Updated last year
- Script for downloading GitHub.☆88Updated 4 months ago
- All available datasets for Instruction Tuning of Large Language Models☆237Updated 11 months ago
- Chain-of-Hindsight, A Scalable RLHF Method☆220Updated last year
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆199Updated 6 months ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆114Updated last month
- An experimental implementation of the retrieval-enhanced language model☆75Updated last year
- Code repository for the c-BTM paper☆105Updated last year
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆306Updated last year
- evol augment any dataset online☆55Updated last year
- Techniques used to run BLOOM at inference in parallel☆37Updated 2 years ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆44Updated 10 months ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆79Updated last year