Alternatives and similar repositories for microGRPO

Users that are interested in microGRPO are comparing it to the libraries listed below

• upiterbarg / diff_history
  [ICML 2024] Official code release accompanying the paper "diff History for Neural Language Agents" (Piterbarg, Pinto, Fergus)
  ☆20Updated last year
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆181Updated 6 months ago
• facebookresearch / oni
  Learn online intrinsic rewards from LLM feedback
  ☆45Updated 11 months ago
• LeonGuertler / UnstableBaselines
  ☆106Updated last month
• mklissa / maestromotif
  Skill Design From AI Feedback
  ☆32Updated 9 months ago
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆19Updated 9 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆67Updated 7 months ago
• jwhj / OREO
  ☆117Updated 10 months ago
• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆100Updated 4 months ago
• abdulhaim / LMRL-Gym
  ☆106Updated last year
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆145Updated 9 months ago
• Sea-Snell / Implicit-Language-Q-Learning
  Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"
  ☆210Updated 2 years ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆316Updated this week
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆47Updated 11 months ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆32Updated last year
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆125Updated 6 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆46Updated 9 months ago
• agentification / RAFA_code
  ☆144Updated last year
• jrosseruk / Torch2Jax-DeepSeek-R1-Distill-Qwen-1.5B
  Flax (Jax) implementation of DeepSeek-R1-Distill-Qwen-1.5B with weights ported from Hugging Face.
  ☆25Updated 9 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆151Updated 9 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆76Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• CLAIRE-Labo / EvoTune
  Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.
  ☆119Updated last week
• lucidrains / ppo
  An implementation of PPO in Pytorch
  ☆99Updated this week
• VsonicV / es-fine-tuning-paper
  This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"
  ☆261Updated this week
• balrog-ai / BALROG
  Benchmarking Agentic LLM and VLM Reasoning On Games
  ☆207Updated this week
• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆301Updated 10 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆189Updated 8 months ago
• maxencefaldor / omni-epic
  OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Code (ICLR 2025).
  ☆71Updated 11 months ago
• jinpz / q_sharp
  The official code release for Q#: Provably Optimal Distributional RL for LLM Post-Training
  ☆17Updated 8 months ago