Alternatives and similar repositories for gpo:

Users that are interested in gpo are comparing it to the libraries listed below

• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆62Updated 2 months ago
• deeplearning-wisc / args
  ☆34Updated 11 months ago
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆15Updated 3 weeks ago
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆39Updated 3 months ago
• srzer / MOD
  Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".
  ☆18Updated 3 months ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated last year
• ejones313 / auditing-llms
  ☆52Updated last year
• princeton-nlp / benign-data-breaks-safety
  ☆26Updated 3 months ago
• 2003pro / ScaleBiO
  This is the official implementation of ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting
  ☆17Updated 6 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆88Updated 8 months ago
• paul-rottger / exaggerated-safety
  Röttger et al. (2023): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆79Updated last year
• kttian / llm_factuality_tuning
  ☆29Updated 8 months ago
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆49Updated 7 months ago
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆48Updated last year
• tianjunz / TEMPERA
  ☆42Updated last year
• princeton-nlp / InstructEval
  [NAACL 2024 Findings] Evaluation suite for the systematic evaluation of instruction selection methods.
  ☆22Updated last year
• dannyallover / overthinking_the_truth
  ☆30Updated 9 months ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆22Updated 4 months ago
• boyiwei / alignment-attribution-code
  Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
  ☆68Updated 3 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆93Updated last year
• Vaidehi99 / InfoDeletionAttacks
  ☆40Updated last year
• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆55Updated last year
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆66Updated 2 years ago
• zjysteven / mink-plus-plus
  [ICLR'25] Min-K%++: Improved baseline for detecting pre-training data of LLMs
  ☆31Updated this week
• zhxieml / remiss-jailbreak
  ☆21Updated 7 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆54Updated 4 months ago
• ruiqi-zhong / nlparam
  Augmenting Statistical Models with Natural Language Parameters
  ☆22Updated 4 months ago
• WANGXinyiLinda / concept-based-demonstration-selection
  Offical code of the paper Large Language Models Are Implicitly Topic Models: Explaining and Finding Good Demonstrations for In-Context Le…
  ☆70Updated 10 months ago
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆72Updated last month
• wzhouad / WPO
  Code and models for EMNLP 2024 paper "WPO: Enhancing RLHF with Weighted Preference Optimization"
  ☆33Updated 4 months ago