Curated list of datasets and tools for post-training.
☆4,830Apr 29, 2026Updated 6 months ago
Alternatives and similar repositories for llm-datasets
Users that are interested in llm-datasets are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,449Updated this week
- A quick guide (especially) for trending instruction finetuning datasets☆3,420Nov 28, 2023Updated 2 years ago
- Tools for merging pretrained large language models.☆7,430Updated this week
- Go ahead and axolotl questions☆12,660Updated this week
- A framework for few-shot evaluation of language models.☆14,387Sep 14, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.☆84,878Feb 5, 2026Updated 8 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,578Updated this week
- Automatically evaluate your LLMs in Google Colab☆699May 7, 2024Updated 2 years ago
- Robust recipes to align language models with human and AI preferences☆5,707Sep 23, 2026Updated last month
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆78,910Updated this week
- A course on aligning smol models.☆6,788Oct 6, 2026Updated 3 weeks ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,744Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆3,414Updated this week
- AllenAI's post-training codebase☆3,924Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Train transformer language models with reinforcement learning.☆19,663Updated this week
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆2,163Dec 3, 2025Updated 11 months ago
- Minimalistic large language model 3D-parallelism training☆2,853Oct 8, 2026Updated 3 weeks ago
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆75,848Updated this week
- Synthetic data curation for post-training and structured data extraction☆1,763Updated this week
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆18,579May 19, 2026Updated 5 months ago
- A reading list on LLM based Synthetic Data Generation 🔥☆1,555Jun 5, 2025Updated last year
- PyTorch native post-training library☆5,821Sep 9, 2026Updated last month
- DSPy: The framework for programming—not prompting—language models☆38,904Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices☆5,413Apr 22, 2026Updated 6 months ago
- Fast Multimodal Semantic Deduplication & Filtering☆978Oct 4, 2026Updated last month
- Fully open reproduction of DeepSeek-R1☆26,474Oct 26, 2026Updated last week
- Summarize existing representative LLMs text datasets.☆1,483Mar 11, 2026Updated 7 months ago
- Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets☆5,193Updated this week
- awesome synthetic (text) datasets☆343Aug 2, 2026Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,224Updated this week
- The LLM Evaluation Framework☆19,272Updated this week
- Structured Outputs☆15,997Sep 21, 2026Updated last month
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Implement a ChatGPT-like LLM in PyTorch from scratch, step by step☆107,751Updated this week
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆24,116Updated this week
- This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed not…☆30,217Updated this week
- Large Language Model Text Generation Inference☆10,883Mar 21, 2026Updated 7 months ago
- llama3 implementation one matrix multiplication at a time☆15,203May 23, 2024Updated 2 years ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,834May 28, 2026Updated 5 months ago
- Efficient Triton Kernels for LLM Training☆6,683Updated this week