Alternatives and similar repositories for gpo

Users that are interested in gpo are comparing it to the libraries listed below

• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆37Updated 3 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆100Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆76Updated 5 months ago
• deeplearning-wisc / args
  ☆44Updated last year
• princeton-nlp / unintentional-unalignment
  [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆31Updated 7 months ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆19Updated last year
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆58Updated last year
• ejones313 / auditing-llms
  ☆57Updated 2 years ago
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆51Updated last year
• ruiqi-zhong / nlparam
  Augmenting Statistical Models with Natural Language Parameters
  ☆27Updated 11 months ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆123Updated 11 months ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆110Updated 6 months ago
• NingMiao / SelfCheck
  Code for the paper <SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning>
  ☆49Updated 2 years ago
• dunzeng / MORE
  Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment
  ☆16Updated last year
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆23Updated last year
• LiuAmber / RAHF
  [ACL 2024 main] Aligning Large Language Models with Human Preferences through Representation Engineering (https://aclanthology.org/2024.…
  ☆26Updated 11 months ago
• Jiuzhouh / Uncertainty-Aware-Language-Agent
  This is the official repo for Towards Uncertainty-Aware Language Agent.
  ☆28Updated last year
• kttian / llm_factuality_tuning
  ☆36Updated last year
• srzer / MOD
  Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".
  ☆25Updated 10 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆97Updated last year
• tatsu-lab / test_set_contamination
  ☆39Updated last year
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆79Updated 8 months ago
• Linear95 / DSP
  Domain-specific preference (DSP) data and customized RM fine-tuning.
  ☆25Updated last year
• GXimingLu / IPA
  Codebase for Inference-Time Policy Adapters
  ☆24Updated last year
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆59Updated 11 months ago
• tianjunz / TEMPERA
  ☆46Updated 2 years ago
• activatedgeek / calibration-tuning
  ☆52Updated 4 months ago
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆60Updated 2 years ago
• zlin7 / UQ-NLG
  ☆99Updated last year