jianzhnie / awesome-instruction-datasets
A collection of awesome-prompt-datasets, awesome-instruction-dataset, to train ChatLLM such as chatgpt 收录各种各样的指令数据集, 用于训练 ChatLLM 模型。
☆589Updated 9 months ago
Alternatives and similar repositories for awesome-instruction-datasets:
Users that are interested in awesome-instruction-datasets are comparing it to the libraries listed below
- Aligning Large Language Models with Human: A Survey☆712Updated last year
- Official repository for ICLR 2025 paper "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient an…☆587Updated last week
- A curated list of awesome instruction tuning datasets, models, papers and repositories.☆323Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆531Updated last month
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆791Updated this week
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆450Updated 10 months ago
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).☆759Updated last year
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆540Updated 10 months ago
- OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.☆544Updated last year
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆610Updated 6 months ago
- Papers and Datasets on Instruction Tuning and Following. ✨✨✨☆477Updated 9 months ago
- Generative Representational Instruction Tuning☆588Updated last week
- Official repository for ORPO☆432Updated 7 months ago
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,116Updated 10 months ago
- Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning☆388Updated 8 months ago
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆803Updated 2 months ago
- A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.☆337Updated last year
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆406Updated 3 months ago
- A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)☆1,099Updated last year
- RewardBench: the first evaluation tool for reward models.☆493Updated this week
- Codebase for Merging Language Models (ICML 2024)☆793Updated 8 months ago
- [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning☆581Updated 10 months ago
- ☆489Updated 2 months ago
- Chat Templates for 🤗 HuggingFace Large Language Models☆597Updated last month
- A large-scale, fine-grained, diverse preference dataset (and models).☆327Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆903Updated 3 months ago
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆454Updated 7 months ago
- distributed trainer for LLMs☆555Updated 8 months ago
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning☆637Updated 7 months ago
- ☆797Updated this week