Alternatives and similar repositories for grpo-loss:

Users that are interested in grpo-loss are comparing it to the libraries listed below

• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆50Updated last month
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆56Updated 11 months ago
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆35Updated 10 months ago
• Zheng0428 / COIG-Kun
  ☆36Updated 6 months ago
• Alibaba-NLP / RankingGPT
  code for paper 《RankingGPT: Empowering Large Language Models in Text Ranking with Progressive Enhancement》
  ☆31Updated last year
• nishiwen1214 / Benchmark-leakage-detection
  Official completion of “Training on the Benchmark Is Not All You Need”.
  ☆30Updated 3 months ago
• yyDing1 / ScaleQuest
  We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆60Updated 5 months ago
• AlphaPav / mem-kk-logic
  On Memorization of Large Language Models in Logical Reasoning
  ☆60Updated this week
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆30Updated 10 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆72Updated last year
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆67Updated last week
• bytarnish / AGILE
  ☆115Updated 2 months ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆102Updated 3 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆46Updated 3 months ago
• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆36Updated last week
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆115Updated 6 months ago
• MadeAgents / Hammer
  Hammer: Robust Function-Calling for On-Device Language Models via Function Masking
  ☆63Updated last month
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆57Updated 3 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆84Updated 2 months ago
• facebookresearch / iGSM
  The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…
  ☆40Updated 2 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆46Updated last month
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆43Updated 10 months ago
• BestAnHongjun / SentenceVAE
  Enable Next-sentence Prediction for Large Language Models with Faster Speed, Higher Accuracy and Longer Context
  ☆28Updated 7 months ago
• yongchao98 / PROMST
  Automatic prompt optimization framework for multi-step agent tasks.
  ☆28Updated 4 months ago
• yegcjs / mixinglaws
  ☆98Updated 6 months ago
• NumberChiffre / mcts-llm
  ☆91Updated 3 months ago
• shizhediao / Post-Training-Data-Flywheel
  We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.
  ☆54Updated 5 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆51Updated last month
• QwenLM / online_merging_optimizers
  Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
  ☆74Updated 9 months ago
• GuanghaoYe / Emergence-of-Thinking
  ☆48Updated last month