Alternatives and similar repositories for dpo-notes

Users that are interested in dpo-notes are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆98Updated 7 months ago
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆105Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆85Updated last year
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆295Updated this week
• TsinghuaC3I / SSRL
  SSRL: Self-Search Reinforcement Learning
  ☆147Updated 2 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆177Updated 7 months ago
• tianyi-lab / MoE-Embedding
  [ICLR 2025 Oral] "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆82Updated last year
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆107Updated 10 months ago
• SALT-NLP / demonstrated-feedback
  ☆128Updated last year
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆135Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• MLE-Dojo / MLE-Dojo
  ☆77Updated 2 months ago
• efficientscaling / Z1
  [EMNLP'2025 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆65Updated 6 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆115Updated 8 months ago
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆108Updated 4 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆77Updated 6 months ago
• neubig / minllama-assignment
  ☆98Updated last year
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆299Updated last month
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆67Updated 5 months ago
• ScalingIntelligence / large_language_monkeys
  ☆108Updated last year
• google-deepmind / bbeh
  ☆99Updated 5 months ago
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆55Updated last year
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆93Updated 5 months ago
• ypwang61 / One-Shot-RLVR
  [NeurIPS 2025] Reinforcement Learning for Reasoning in Large Language Models with One Training Example
  ☆365Updated 2 weeks ago
• LiqiangJing / DSBench
  [ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆78Updated 2 months ago
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆39Updated last year
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆66Updated 7 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]
  ☆178Updated 3 months ago
• mukhal / ThinkPRM
  Process Reward Models That Think
  ☆59Updated 2 weeks ago