Alternatives and similar repositories for dpo-notes

Users that are interested in dpo-notes are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆102Updated 10 months ago
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆111Updated last year
• tianyi-lab / MoE-Embedding
  [ICLR 2025 Oral] "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆89Updated last year
• ScalingIntelligence / large_language_monkeys
  ☆112Updated last year
• neubig / minllama-assignment
  ☆100Updated last year
• idanshen / Self-Distillation
  ☆236Updated last week
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆163Updated 9 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆93Updated last year
• sanyalsunny111 / LLM-Inheritune
  [TMLR 2026] When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models
  ☆122Updated last year
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆141Updated last year
• devvrit / matformer
  MatFormer repo
  ☆70Updated last year
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆116Updated last year
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆344Updated last month
• TsinghuaC3I / SSRL
  SSRL: Self-Search Reinforcement Learning
  ☆206Updated 5 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 9 months ago
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆54Updated last year
• Nardien / agent-distillation
  Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"
  ☆200Updated 3 months ago
• efficientscaling / Z1
  [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆68Updated 10 months ago
• SALT-NLP / demonstrated-feedback
  ☆130Updated last year
• nick7nlp / FastCuRL
  FastCuRL: Curriculum Reinforcement Learning with Stage-wise Context Scaling for Efficient LLM Reasoning
  ☆57Updated 4 months ago
• shangshang-wang / Tina
  [ICLR 2026] Tina: Tiny Reasoning Models via LoRA
  ☆319Updated 4 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆188Updated 2 months ago
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆125Updated 8 months ago
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆53Updated last year
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]
  ☆216Updated 2 months ago
• MLE-Dojo / MLE-Dojo
  ☆90Updated 3 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]
  ☆180Updated 7 months ago
• SalesforceAIResearch / GemFilter
  ☆84Updated 3 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆118Updated last year