Alternatives and similar repositories for gpo:

Users that are interested in gpo are comparing it to the libraries listed below

• deeplearning-wisc / args
  ☆36Updated last year
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆50Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆64Updated 3 months ago
• zjysteven / mink-plus-plus
  [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs
  ☆35Updated 2 weeks ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆89Updated 9 months ago
• kttian / llm_factuality_tuning
  ☆30Updated 10 months ago
• srzer / MOD
  Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".
  ☆19Updated 4 months ago
• Princeton-SysML / kNNLM_privacy
  Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888
  ☆35Updated 8 months ago
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆15Updated last month
• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆25Updated 4 months ago
• ADaM-BJTU / W2SG
  The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”
  ☆15Updated last year
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆41Updated 4 months ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated last month
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆16Updated last year
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆56Updated 5 months ago
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆20Updated last year
• chujiezheng / LLM-MCQ-Bias
  Official repository for ICLR 2024 Spotlight paper "Large Language Models Are Not Robust Multiple Choice Selectors"
  ☆38Updated 8 months ago
• BrachioLab / incontext_influences
  In-context Example Selection with Influences
  ☆15Updated last year
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆58Updated 2 years ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated last year
• activatedgeek / calibration-tuning
  ☆45Updated 6 months ago
• YangRui2015 / RiC
  Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"
  ☆57Updated 2 months ago
• princeton-nlp / benign-data-breaks-safety
  ☆30Updated 5 months ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆66Updated 2 years ago
• princeton-nlp / InstructEval
  [NAACL 2024 Findings] Evaluation suite for the systematic evaluation of instruction selection methods.
  ☆22Updated last year
• alexrame / rewardedsoups
  Rewarded soups official implementation
  ☆54Updated last year
• Jiuzhouh / Uncertainty-Aware-Language-Agent
  This is the official repo for Towards Uncertainty-Aware Language Agent.
  ☆24Updated 6 months ago
• BeyonderXX / TRACE
  TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
  ☆64Updated last year
• tatsu-lab / test_set_contamination
  ☆37Updated last year
• dunzeng / MORE
  Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment
  ☆15Updated 6 months ago