Alternatives and similar repositories for gpo:

Users that are interested in gpo are comparing it to the libraries listed below

• deeplearning-wisc / args
  ☆37Updated last year
• princeton-nlp / InstructEval
  [NAACL 2024 Findings] Evaluation suite for the systematic evaluation of instruction selection methods.
  ☆22Updated last year
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆50Updated last year
• YuxiXie / SelfEval-Guided-Decoding
  ☆95Updated last year
• princeton-nlp / benign-data-breaks-safety
  ☆34Updated 6 months ago
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆22Updated last year
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆41Updated 5 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆19Updated last month
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆89Updated 10 months ago
• 2003pro / ScaleBiO
  This is the official implementation of ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting
  ☆17Updated 8 months ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated last year
• kttian / llm_factuality_tuning
  ☆30Updated 11 months ago
• tatsu-lab / test_set_contamination
  ☆37Updated last year
• princeton-nlp / unintentional-unalignment
  [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆23Updated 2 months ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated 2 months ago
• jaechan-repo / muse_bench
  ☆19Updated 7 months ago
• JasonForJoy / Model-Editing-Hurt
  EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
  ☆35Updated 4 months ago
• qcznlp / uncertainty_attack
  ☆16Updated 6 months ago
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆22Updated 9 months ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆119Updated 6 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆56Updated 6 months ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆66Updated 2 years ago
• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆37Updated 3 weeks ago
• GAIR-NLP / alignment-for-honesty
  ☆73Updated 10 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆71Updated 3 weeks ago
• Zhou-Zoey / RMB-Reward-Model-Benchmark
  ☆30Updated last week
• Linear95 / DSP
  Domain-specific preference (DSP) data and customized RM fine-tuning.
  ☆25Updated last year
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆58Updated 2 years ago
• deeplearning-wisc / picle
  Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)
  ☆23Updated 9 months ago
• RUCAIBox / HaluEval-2.0
  ☆41Updated last year