Alternatives and similar repositories for RL4LLM

Users that are interested in RL4LLM are comparing it to the libraries listed below

• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 9 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆105Updated 3 weeks ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 2 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 4 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated last month
• THU-KEG / Agentic-Reward-Modeling
  Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆90Updated 2 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆56Updated last month
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆95Updated 3 months ago
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆44Updated 8 months ago
• HarleyCoops / smolThinker-.5B
  A Qwen .5B reasoning model trained on OpenR1-Math-220k
  ☆14Updated 3 months ago
• efficientscaling / Z1
  Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆59Updated last month
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆42Updated 5 months ago
• convergence-ai / lm2
  Official repo of paper LM2
  ☆40Updated 3 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆32Updated 2 weeks ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆151Updated last month
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆41Updated 4 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆31Updated 3 months ago
• hkproj / multi-latent-attention
  ☆35Updated last week
• kabir2505 / tiny-mixtral
  ☆39Updated last month
• rsshyam / GRPO
  ☆59Updated 10 months ago
• RobertCsordas / moeut
  ☆79Updated 9 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆126Updated last week
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆245Updated last week
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆147Updated 2 months ago
• geronimi73 / 3090_shorts
  minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆39Updated last week
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆54Updated 8 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆31Updated 2 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year