Alternatives and similar repositories for dpo-notes

Users that are interested in dpo-notes are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆100Updated 9 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆89Updated last year
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆111Updated last year
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆139Updated last year
• tianyi-lab / MoE-Embedding
  [ICLR 2025 Oral] "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆83Updated last year
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆69Updated 8 months ago
• TsinghuaC3I / SSRL
  SSRL: Self-Search Reinforcement Learning
  ☆158Updated 3 months ago
• neubig / minllama-assignment
  ☆99Updated last year
• Mr-Tieguigui / LLM-Post-Training
  ☆76Updated 6 months ago
• QwenLM / WorldPM
  ☆92Updated 7 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆116Updated 10 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 8 months ago
• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆109Updated 3 weeks ago
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆72Updated 7 months ago
• Nardien / agent-distillation
  Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"
  ☆177Updated last month
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆56Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆218Updated 9 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆185Updated last month
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆66Updated last year
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆162Updated 8 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆113Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated 10 months ago
• ali-bahrainian / RAG_best_practices
  ☆103Updated 8 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆47Updated last year
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆310Updated 2 months ago
• Gen-Verse / Open-AgentRL
  Demystifying Reinforcement Learning in Agentic Reasoning
  ☆128Updated 2 months ago
• efficientscaling / Z1
  [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆67Updated 8 months ago
• neulab / agent-data-protocol
  ☆118Updated last week
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]
  ☆209Updated 2 weeks ago