bigcode-project / octopack
🐙 OctoPack: Instruction Tuning Code Large Language Models
☆457Updated last month
Alternatives and similar repositories for octopack:
Users that are interested in octopack are comparing it to the libraries listed below
- ☆634Updated 4 months ago
- Run evaluation on LLMs using human-eval benchmark☆398Updated last year
- A framework for the evaluation of autoregressive code generation language models.☆902Updated 4 months ago
- ☆268Updated last year
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆543Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆146Updated 6 months ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆236Updated 4 months ago
- Fine-tune SantaCoder for Code/Text Generation.☆190Updated last year
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆371Updated 8 months ago
- Simple next-token-prediction for RLHF☆222Updated last year
- Data and code for FreshLLMs (https://arxiv.org/abs/2310.03214)☆345Updated this week
- [ICLR 2024] Lemur: Open Foundation Models for Language Agents☆542Updated last year
- Open Source WizardCoder Dataset☆155Updated last year
- Data and code for "DocPrompting: Generating Code by Retrieving the Docs" @ICLR 2023☆241Updated last year
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆468Updated 8 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆298Updated last year
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆298Updated 2 weeks ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆209Updated 10 months ago
- Build, evaluate, understand, and fix LLM-based apps☆487Updated last year
- PaL: Program-Aided Language Models (ICML 2023)☆482Updated last year
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467☆279Updated 3 weeks ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆133Updated 7 months ago
- Accepted by Transactions on Machine Learning Research (TMLR)☆126Updated 5 months ago
- Generate textbook-quality synthetic LLM pretraining data☆498Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆920Updated 4 months ago
- A multi-programming language benchmark for LLMs☆235Updated last month
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆510Updated last month
- Data and Code for Program of Thoughts (TMLR 2023)☆263Updated 9 months ago
- This project is an attempt to create a common metric to test LLM's for progress in eliminating hallucinations which is the most serious c…☆222Updated last year
- Official repository for LongChat and LongEval☆516Updated 9 months ago