A quick guide (especially) for trending instruction finetuning datasets
☆3,367Nov 28, 2023Updated 2 years ago
Alternatives and similar repositories for LLMDataHub
Users that are interested in LLMDataHub are comparing it to the libraries listed below
Sorting:
- Curated list of datasets and tools for post-training.☆4,265Nov 10, 2025Updated 3 months ago
- A framework for few-shot evaluation of language models.☆11,540Updated this week
- Train transformer language models with reinforcement learning.☆17,523Updated this week
- Instruction Tuning with GPT-4☆4,341Jun 11, 2023Updated 2 years ago
- Robust recipes to align language models with human and AI preferences☆5,510Sep 8, 2025Updated 5 months ago
- Tools for merging pretrained large language models.☆6,826Updated this week
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆67,659Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,426Jun 2, 2025Updated 9 months ago
- Aligning pretrained language models with instruction data generated by themselves.☆4,580Mar 27, 2023Updated 2 years ago
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆20,717Updated this week
- Awesome-LLM: a curated list of Large Language Model☆26,378Jul 31, 2025Updated 7 months ago
- A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)☆1,143Jan 4, 2024Updated 2 years ago
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,923Dec 7, 2024Updated last year
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,477Jun 7, 2025Updated 8 months ago
- Go ahead and axolotl questions☆11,395Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,883Updated this week
- Summarize existing representative LLMs text datasets.☆1,436Oct 11, 2025Updated 4 months ago
- OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …☆6,705Feb 27, 2026Updated last week
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,843Jun 10, 2024Updated last year
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & TIS & vLLM & Ray & Async RL)☆9,084Updated this week
- Fast and memory-efficient exact attention☆22,460Updated this week
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,766Aug 4, 2024Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,108Feb 23, 2026Updated last week
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,797Dec 12, 2023Updated 2 years ago
- A collection of awesome-prompt-datasets, awesome-instruction-dataset, to train ChatLLM such as chatgpt 收录各种各样的指令数据集, 用于 训练 ChatLLM 模型。☆724Apr 7, 2024Updated last year
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,271Jul 17, 2024Updated last year
- AllenAI's post-training codebase☆3,605Updated this week
- MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂 志…☆4,128Jan 31, 2026Updated last month
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆18,220Nov 3, 2025Updated 4 months ago
- BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）☆8,281Oct 16, 2024Updated last year
- Large Language Model Text Generation Inference☆10,788Jan 8, 2026Updated last month
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,915Updated this week
- Latest Advances on Multimodal Large Language Models☆17,385Feb 23, 2026Updated last week
- Ongoing research training transformer models at scale☆15,461Updated this week
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,896May 3, 2024Updated last year
- Retrieval and Retrieval-augmented LLMs☆11,352Dec 15, 2025Updated 2 months ago
- ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡☆2,952Nov 26, 2023Updated 2 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆41,706Updated this week
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆5,027Apr 11, 2025Updated 10 months ago