Alternatives and similar repositories for dpo-notes

Users that are interested in dpo-notes are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆98Updated 6 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆83Updated last year
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆105Updated last year
• tianyi-lab / MoE-Embedding
  Code for "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆83Updated 11 months ago
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆134Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆177Updated 6 months ago
• neubig / minllama-assignment
  ☆96Updated last year
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆290Updated last week
• SALT-NLP / demonstrated-feedback
  ☆127Updated last year
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆121Updated 4 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆161Updated 5 months ago
• TsinghuaC3I / SSRL
  SSRL: Self-Search Reinforcement Learning
  ☆145Updated last month
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆196Updated 6 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆115Updated 7 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆64Updated last year
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆55Updated last year
• efficientscaling / Z1
  [EMNLP 2025 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆64Updated 5 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆66Updated 6 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆129Updated 8 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆172Updated last year
• StigLidu / DualDistill
  [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆100Updated last month
• rsshyam / GRPO
  ☆67Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆74Updated 5 months ago
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆66Updated 5 months ago
• lili-chen / self-questioning-lm
  Self-Questioning Language Models
  ☆50Updated 2 weeks ago
• AIMO-CMU-MATH / CMU_MATH-AIMO
  ☆76Updated last year
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆106Updated 3 months ago