A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
☆1,144Jan 4, 2024Updated 2 years ago
Alternatives and similar repositories for awesome-instruction-dataset
Users that are interested in awesome-instruction-dataset are comparing it to the libraries listed below
Sorting:
- Datasets for Instruction Tuning of Large Language Models☆261Nov 30, 2023Updated 2 years ago
- A curated list of awesome instruction tuning datasets, models, papers and repositories.☆347Jun 12, 2023Updated 2 years ago
- Papers and Datasets on Instruction Tuning and Following. ✨✨✨☆508Apr 4, 2024Updated last year
- Instruction Tuning with GPT-4☆4,341Jun 11, 2023Updated 2 years ago
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).☆766Jul 20, 2023Updated 2 years ago
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,797Dec 12, 2023Updated 2 years ago
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,923Dec 7, 2024Updated last year
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,766Aug 4, 2024Updated last year
- A collection of awesome-prompt-datasets, awesome-instruction-dataset, to train ChatLLM such as chatgpt 收录各种各样的指令数据集, 用于训练 ChatLLM 模型。☆724Apr 7, 2024Updated last year
- A list of totally open alternatives to ChatGPT☆4,749May 3, 2023Updated 2 years ago
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,933Mar 14, 2024Updated last year
- Aligning pretrained language models with instruction data generated by themselves.☆4,582Mar 27, 2023Updated 2 years ago
- [NIPS2023] RRHF & Wombat☆809Sep 22, 2023Updated 2 years ago
- Alpaca dataset from Stanford, cleaned and curated☆1,582Apr 14, 2023Updated 2 years ago
- AllenAI's post-training codebase☆3,614Updated this week
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,533Jul 16, 2023Updated 2 years ago
- ☆1,559Feb 20, 2026Updated 2 weeks ago
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,738Jan 8, 2024Updated 2 years ago
- Expanding natural instructions☆1,035Dec 11, 2023Updated 2 years ago
- A quick guide (especially) for trending instruction finetuning datasets☆3,368Nov 28, 2023Updated 2 years ago
- Instruct-tune LLaMA on consumer hardware☆18,964Jul 29, 2024Updated last year
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,267Jul 17, 2024Updated last year
- Open Academic Research on Improving LLaMA to SOTA LLM☆1,610Aug 30, 2023Updated 2 years ago
- Robust recipes to align language models with human and AI preferences☆5,510Sep 8, 2025Updated 6 months ago
- A framework for few-shot evaluation of language models.☆11,618Updated this week
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,517Aug 13, 2024Updated last year
- Train transformer language models with reinforcement learning.☆17,523Updated this week
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,824Jun 17, 2025Updated 8 months ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,478Jun 7, 2025Updated 9 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,426Jun 2, 2025Updated 9 months ago
- A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer☆1,629Sep 15, 2023Updated 2 years ago
- Let ChatGPT teach your own chatbot in hours with a single GPU!☆3,168Mar 17, 2024Updated last year
- ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡☆2,952Nov 26, 2023Updated 2 years ago
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆20,717Updated this week
- An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.☆8,490Feb 15, 2026Updated 3 weeks ago
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆552Mar 10, 2024Updated last year
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆842Jul 1, 2024Updated last year
- ☆461Jun 9, 2024Updated last year
- A curated list of reinforcement learning with human feedback resources (continually updated)☆4,317Dec 9, 2025Updated 3 months ago