Train transformer language models with reinforcement learning.
β19,354Sep 21, 2026Updated this week
Alternatives and similar repositories for trl
Users that are interested in trl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- π€ PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.β21,709Updated this week
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Frameworkβ23,515Updated this week
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Asyβ¦β10,026Updated this week
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)β4,754Jan 8, 2024Updated 2 years ago
- A modular RL library to fine-tune language models to human preferencesβ2,396Mar 1, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fast and memory-efficient exact attentionβ24,991Updated this week
- Fully open reproduction of DeepSeek-R1β26,477Apr 2, 2026Updated 5 months ago
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)β74,958Sep 14, 2026Updated last week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.β43,148Updated this week
- Robust recipes to align language models with human and AI preferencesβ5,680Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMsβ92,343Updated this week
- Ongoing research training transformer models at scaleβ17,967Updated this week
- A framework for few-shot evaluation of language models.β14,047Sep 14, 2026Updated last week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.β39,543May 1, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available β’ AdRun AI, ML, and HPC workloads on powerful cloud GPUsβwithout limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Large Language Model Text Generation Inferenceβ10,885Mar 21, 2026Updated 6 months ago
- Reference implementation for DPO (Direct Preference Optimization)β2,911Aug 11, 2024Updated 2 years ago
- π A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iβ¦β9,876Updated this week
- Code and documentation to train Stanford's Alpaca models, and generate the data.β30,232Jul 17, 2024Updated 2 years ago
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.β25,032Aug 12, 2024Updated 2 years ago
- Example models using DeepSpeedβ6,848Updated this week
- QLoRA: Efficient Finetuning of Quantized LLMsβ11,019Jun 10, 2024Updated 2 years ago
- Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VLβ¦β15,696Updated this week
- SGLang is a high-performance serving framework for large language models and multimodal models.β36,263Updated this week
- GPU virtual machines on DigitalOcean Gradient AI β’ AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalitiesβ22,224Updated this week
- π€ Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal modelβ¦β166,469Updated this week
- Accessible large language models via k-bit quantization for PyTorch.β8,487Sep 7, 2026Updated 2 weeks ago
- Inference code for Llama modelsβ59,618Jan 26, 2025Updated last year
- A curated list of reinforcement learning with human feedback resources (continually updated)β4,426May 20, 2026Updated 4 months ago
- Instruct-tune LLaMA on consumer hardwareβ18,904Jul 29, 2024Updated 2 years ago
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.β76,531Updated this week
- Democratizing Reinforcement Learning for LLMsβ5,831Sep 12, 2026Updated last week
- slime is an LLM post-training framework for RL Scaling.β8,516Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI β’ AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Tools for merging pretrained large language models.β7,364Sep 12, 2026Updated last week
- Aligning pretrained language models with instruction data generated by themselves.β4,611Mar 27, 2023Updated 3 years ago
- Simple RL training for reasoningβ3,873Dec 23, 2025Updated 8 months ago
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRLβ5,169Updated this week
- Code for the paper Fine-Tuning Language Models from Human Preferencesβ1,388Jul 25, 2023Updated 3 years ago
- Making large AI models cheaper, faster and more accessibleβ41,438Updated this week
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We alsβ¦β18,558May 19, 2026Updated 4 months ago