Alternatives and similar repositories for dpo-notes:

Users that are interested in dpo-notes are comparing it to the libraries listed below

• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆66Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆88Updated last month
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆47Updated last week
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆90Updated last year
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆47Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 7 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 8 months ago
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆64Updated 9 months ago
• neubig / minllama-assignment
  ☆85Updated 7 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆111Updated 3 months ago
• liuqi6777 / llm4ranking
  Large language models for document ranking.
  ☆51Updated 3 weeks ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated 11 months ago
• nyunAI / Faster-LLM-Survey
  ☆42Updated last year
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆54Updated 7 months ago
• chenyiqun / MMOA-RAG
  This is the code of MMOA-RAG.
  ☆51Updated last month
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆99Updated 7 months ago
• THUDM / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆99Updated 3 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated last year
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆84Updated 7 months ago
• neubig / nlp-from-scratch-assignment-spring2024
  An assignment for building an NLP system from scratch.
  ☆25Updated last year
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 3 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 8 months ago
• srush / LLM-Talk
  ☆49Updated last year
• TergelMunkhbat / concise-reasoning
  Code for paper called Self-Training Elicits Concise Reasoning in Large Language Models
  ☆30Updated 2 weeks ago
• tianyi-lab / MoE-Embedding
  Code for "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆68Updated 6 months ago
• azminewasi / Awesome-LLMs-ICLR-24
  It is a comprehensive resource hub compiling all LLM papers accepted at the International Conference on Learning Representations (ICLR) i…
  ☆61Updated last year
• rsshyam / GRPO
  ☆58Updated 9 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆128Updated 2 months ago
• stanford-cs336 / spring2025-lectures
  ☆91Updated last week
• MingLiiii / Layer_Gradient
  What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆63Updated 2 months ago