Alternatives and similar repositories for RL4LLM:

Users that are interested in RL4LLM are comparing it to the libraries listed below

• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆91Updated this week
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 7 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆87Updated 2 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆168Updated 2 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆150Updated 3 months ago
• JacobPfau / fillerTokens
  ☆60Updated 11 months ago
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆145Updated this week
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆83Updated last month
• convergence-ai / lm2
  Official repo of paper LM2
  ☆34Updated last month
• SalesforceAIResearch / LaTRO
  ☆111Updated last month
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 7 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆109Updated 3 weeks ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated 3 months ago
• attentionmech / mav
  model activation visualiser
  ☆90Updated this week
• arcee-ai / DAM
  ☆48Updated 4 months ago
• RobertCsordas / moeut
  ☆74Updated 7 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆81Updated 3 weeks ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆99Updated this week
• writer / writing-in-the-margins
  ☆115Updated 7 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆39Updated 3 months ago
• mistralai / mistral-evals
  ☆66Updated last week
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆91Updated 3 weeks ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆140Updated this week
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆53Updated last week
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with Reinforcement Learning (RL) on GSM8K, inspired by RLVR and Deepseek R1. This repositor…
  ☆72Updated last month
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆209Updated last week
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆97Updated 6 months ago
• menhguin / minp_paper
  Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper
  ☆28Updated 2 weeks ago
• mkurman / grpo-llm-evaluator
  Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…
  ☆39Updated 3 weeks ago