Alternatives and similar repositories for RL4LLM

Users that are interested in RL4LLM are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆98Updated 6 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆120Updated 4 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆172Updated 8 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 7 months ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated 9 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 6 months ago
• HarleyCoops / smolThinker-.5B
  A Qwen .5B reasoning model trained on OpenR1-Math-220k
  ☆14Updated 7 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆40Updated 7 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆129Updated 7 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆195Updated 6 months ago
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆49Updated last year
• StigLidu / DualDistill
  [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆100Updated last month
• rsshyam / GRPO
  ☆67Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 5 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆240Updated 11 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆284Updated last week
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆250Updated last month
• efficientscaling / Z1
  [EMNLP 2025 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆64Updated 5 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆74Updated 5 months ago
• RobertCsordas / moeut
  ☆85Updated last year
• SalesforceAIResearch / LaTRO
  ☆123Updated 7 months ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆128Updated last year
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆178Updated last year
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆113Updated 7 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆105Updated 6 months ago
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆72Updated 5 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆109Updated 6 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆290Updated last week