bigcode-project / the-stack-v2Links
Code for the curation of The Stack v2 and StarCoder2 training data
☆110Updated last year
Alternatives and similar repositories for the-stack-v2
Users that are interested in the-stack-v2 are comparing it to the libraries listed below
Sorting:
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆148Updated 9 months ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆145Updated 11 months ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆247Updated 8 months ago
- A multi-programming language benchmark for LLMs☆260Updated 3 weeks ago
- Code for the paper "Efficient Training of Language Models to Fill in the Middle"☆183Updated 2 years ago
- Repository for analysis and experiments in the BigCode project.☆120Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆168Updated 10 months ago
- Async pipelined version of Verl☆106Updated 3 months ago
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆84Updated 9 months ago
- ☆159Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆306Updated last year
- Accepted by Transactions on Machine Learning Research (TMLR)☆129Updated 9 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆228Updated 8 months ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆221Updated last year
- LOFT: A 1 Million+ Token Long-Context Benchmark☆204Updated last month
- Reproducible, flexible LLM evaluations☆219Updated this week
- ☆110Updated 11 months ago
- ☆464Updated 11 months ago
- CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings☆44Updated 5 months ago
- Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718☆341Updated 9 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆145Updated 8 months ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆89Updated 2 years ago
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆469Updated 5 months ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆150Updated last year
- Open Source WizardCoder Dataset☆159Updated 2 years ago
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆126Updated last year
- The evaluation code for MultiIF multi-turn and multi-lingual instruction following☆51Updated 8 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆154Updated last year
- RepoQA: Evaluating Long-Context Code Understanding☆109Updated 8 months ago
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆383Updated last year