Alternatives and similar repositories for dpo-notes

Users that are interested in dpo-notes are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆100Updated 8 months ago
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆110Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆88Updated last year
• tianyi-lab / MoE-Embedding
  [ICLR 2025 Oral] "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆82Updated last year
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆312Updated this week
• rsshyam / GRPO
  ☆68Updated last year
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆66Updated last year
• neubig / minllama-assignment
  ☆99Updated last year
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆139Updated last year
• nyunAI / Faster-LLM-Survey
  ☆42Updated last year
• TsinghuaC3I / SSRL
  SSRL: Self-Search Reinforcement Learning
  ☆157Updated 3 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆215Updated 8 months ago
• Mr-Tieguigui / LLM-Post-Training
  ☆75Updated 6 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆309Updated 2 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆181Updated 3 weeks ago
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆68Updated 8 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆115Updated 9 months ago
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆56Updated last year
• spcl / x1
  Official Implementation of "Reasoning Language Models: A Blueprint"
  ☆91Updated 4 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• clinicalml / co-llm
  Co-LLM: Learning to Decode Collaboratively with Multiple Language Models
  ☆123Updated last year
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year
• devvrit / matformer
  MatFormer repo
  ☆66Updated 11 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 7 months ago
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆115Updated 5 months ago
• QwenLM / WorldPM
  ☆92Updated 6 months ago
• Nardien / agent-distillation
  Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"
  ☆175Updated last month
• FairyFali / SLMs-Survey
  Survey of Small Language Models from Penn State, ...
  ☆219Updated last month
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆43Updated 9 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year