Alternatives and similar repositories for DSP

Users that are interested in DSP are comparing it to the libraries listed below

• Linear95 / APO
  Code for ACL2024 paper - Adversarial Preference Optimization (APO).
  ☆54Updated last year
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆16Updated 5 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆57Updated 9 months ago
• ValueCompass / Alignment-Goal-Survey
  ☆30Updated last year
• thu-ml / Noise-Contrastive-Alignment
  Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)
  ☆54Updated 7 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆57Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆62Updated 11 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 2 months ago
• liziniu / policy_optimization
  Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)
  ☆28Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆50Updated 2 weeks ago
• deeplearning-wisc / args
  ☆40Updated last year
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆30Updated last year
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆32Updated 9 months ago
• Re-Align / AlignTDS
  Analyzing LLM Alignment via Token distribution shift
  ☆16Updated last year
• RZFan525 / Awesome-ScalingLaws
  A curated list of awesome resources dedicated to Scaling Laws for LLMs
  ☆72Updated 2 years ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated last year
• FreedomIntelligence / OVM
  ☆67Updated last year
• swtheing / PF-PPO-RLHF
  ☆33Updated 9 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆61Updated 6 months ago
• chang-github-00 / LLM-Predictive-Decoding
  ☆13Updated 7 months ago
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆62Updated 2 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆73Updated last month
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆43Updated last year
• RUCAIBox / CARP
  ☆17Updated 2 years ago
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆30Updated last month
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of RL Scaling
  ☆62Updated 2 months ago
• halfrot / ALaRM
  [ACL 2024] Code for the paper "ALaRM: Align Language Models via Hierarchical Rewards Modeling"
  ☆25Updated last year
• ZeroYuHuang / Transformer-Patcher
  ☆31Updated last year
• shuyhere / about-super-alignment
  Feeling confused about super alignment? Here is a reading list
  ☆42Updated last year