bigcode-project / bigcode-dataset
☆423Updated 7 months ago
Alternatives and similar repositories for bigcode-dataset:
Users that are interested in bigcode-dataset are comparing it to the libraries listed below
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆458Updated last month
- ☆268Updated last year
- A framework for the evaluation of autoregressive code generation language models.☆912Updated 4 months ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆238Updated 4 months ago
- A multi-programming language benchmark for LLMs☆239Updated 2 months ago
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆543Updated last year
- Fine-tune SantaCoder for Code/Text Generation.☆190Updated last year
- ☆640Updated 4 months ago
- Repository for analysis and experiments in the BigCode project.☆117Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆135Updated 7 months ago
- CodeGen2 models for program synthesis☆274Updated last year
- Run evaluation on LLMs using human-eval benchmark☆400Updated last year
- Open Source WizardCoder Dataset☆156Updated last year
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆308Updated 2 years ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆148Updated 7 months ago
- Code for the curation of The Stack v2 and StarCoder2 training data☆96Updated 11 months ago
- A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.☆137Updated 2 months ago
- Minimal library to train LLMs on TPU in JAX with pjit().☆282Updated last year
- Official repository for LongChat and LongEval☆516Updated 10 months ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆385Updated last month
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆471Updated 8 months ago
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆374Updated 8 months ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆454Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆922Updated 5 months ago
- CodeBERTScore: an automatic metric for code generation, based on BERTScore☆186Updated last year
- ☆122Updated last year
- PaL: Program-Aided Language Models (ICML 2023)☆484Updated last year
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆298Updated last month
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆315Updated 3 weeks ago
- Accepted by Transactions on Machine Learning Research (TMLR)☆126Updated 5 months ago