Alternatives and similar repositories for dpo-notes

Users that are interested in dpo-notes are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆99Updated 8 months ago
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆108Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆86Updated last year
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆297Updated this week
• tianyi-lab / MoE-Embedding
  [ICLR 2025 Oral] "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"
  ☆82Updated last year
• neubig / minllama-assignment
  ☆99Updated last year
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆115Updated 9 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆304Updated last month
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆114Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆179Updated 7 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆162Updated 7 months ago
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year
• TsinghuaC3I / SSRL
  SSRL: Self-Search Reinforcement Learning
  ☆151Updated 2 months ago
• neulab / agent-data-protocol
  ☆98Updated this week
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆79Updated 7 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• FairyFali / SLMs-Survey
  Survey of Small Language Models from Penn State, ...
  ☆213Updated last week
• SiliangZeng / Multi-Turn-RL-Agent
  ☆94Updated 5 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆109Updated 5 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆47Updated 11 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆125Updated 6 months ago
• Zhiyuan-Zeng / RLVE
  [Preprint] RLVE: Scaling Up Reinforcement Learning for Language Models with Adaptive Verifiable Environments
  ☆88Updated this week
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆138Updated last year
• srush / LLM-Talk
  ☆52Updated last year
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆68Updated 6 months ago
• MLE-Dojo / MLE-Dojo
  ☆77Updated 2 weeks ago
• zai-org / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆147Updated 9 months ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆48Updated 9 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆144Updated 9 months ago