Alternatives and similar repositories for dpo-notes

Users that are interested in dpo-notes are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆102Updated 10 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆92Updated last year
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆111Updated last year
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆141Updated last year
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year
• tianyi-lab / MoE-Embedding
  [ICLR 2025 Oral] "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆87Updated last year
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆344Updated last month
• sanyalsunny111 / LLM-Inheritune
  [TMLR 2026] When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models
  ☆121Updated 11 months ago
• neubig / minllama-assignment
  ☆100Updated last year
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆31Updated 11 months ago
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆71Updated 10 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆116Updated this week
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆163Updated 9 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆188Updated 2 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆47Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• da03 / implicit_chain_of_thought
  ☆139Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆231Updated 10 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆118Updated last year
• MLE-Dojo / MLE-Dojo
  ☆89Updated 3 months ago
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 11 months ago
• nyunAI / Faster-LLM-Survey
  ☆42Updated last year
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆313Updated 4 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆61Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆58Updated last week
• ScalingIntelligence / large_language_monkeys
  ☆112Updated last year
• imagination-research / lbt
  [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study
  ☆59Updated last year
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆54Updated last year
• clinicalml / co-llm
  Co-LLM: Learning to Decode Collaboratively with Multiple Language Models
  ☆125Updated last year
• efficientscaling / Z1
  [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆68Updated 9 months ago