jianzhnie / awesome-instruction-datasets
A collection of awesome-prompt-datasets, awesome-instruction-dataset, to train ChatLLM such as chatgpt 收录各种各样的指令数据集, 用于训练 ChatLLM 模型。
☆654Updated last year
Alternatives and similar repositories for awesome-instruction-datasets:
Users that are interested in awesome-instruction-datasets are comparing it to the libraries listed below
- Aligning Large Language Models with Human: A Survey☆727Updated last year
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆681Updated last month
- distributed trainer for LLMs☆573Updated 11 months ago
- [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning☆598Updated last year
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning☆651Updated 10 months ago
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆545Updated last year
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆833Updated last week
- Official repository for ORPO☆448Updated 10 months ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆459Updated last year
- A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)☆1,114Updated last year
- A curated list of awesome instruction tuning datasets, models, papers and repositories.☆334Updated last year
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,154Updated last year
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).☆766Updated last year
- Generative Representational Instruction Tuning☆620Updated last month
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆935Updated 6 months ago
- Official repository for LongChat and LongEval☆519Updated 11 months ago
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆547Updated 4 months ago
- Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.☆715Updated 6 months ago
- ☆515Updated 5 months ago
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆628Updated 9 months ago
- Papers and Datasets on Instruction Tuning and Following. ✨✨✨☆490Updated last year
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,508Updated last year
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,724Updated 3 months ago
- LongBench v2 and LongBench (ACL 2024)☆845Updated 3 months ago
- Scalable toolkit for efficient model alignment☆770Updated last week
- FuseAI Project☆560Updated 3 months ago
- Awesome-LLM-RAG: a curated list of advanced retrieval augmented generation (RAG) in Large Language Models☆1,182Updated 2 months ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆481Updated 3 months ago
- All available datasets for Instruction Tuning of Large Language Models☆248Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,438Updated last week