Alternatives and similar repositories for RL4LLM

Users that are interested in RL4LLM are comparing it to the libraries listed below

• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆138Updated 7 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆100Updated 9 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆310Updated 3 months ago
• HarleyCoops / smolThinker-.5B
  A Qwen .5B reasoning model trained on OpenR1-Math-220k
  ☆14Updated 2 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆219Updated 9 months ago
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆250Updated 4 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆47Updated 10 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆245Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 8 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 10 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆174Updated 11 months ago
• LLM360 / k2-train
  ☆52Updated last year
• hkproj / multi-latent-attention
  ☆45Updated 7 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆151Updated 10 months ago
• geronimi73 / phi2-finetune
  ☆86Updated last year
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆53Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 8 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 9 months ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated last year
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆64Updated 7 months ago
• StigLidu / DualDistill
  [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆100Updated 3 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆111Updated 8 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆108Updated 9 months ago
• rsshyam / GRPO
  ☆68Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆337Updated 8 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆122Updated 2 months ago
• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆108Updated last month
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆37Updated 7 months ago