Alternatives and similar repositories for gpo

Users that are interested in gpo are comparing it to the libraries listed below

• deeplearning-wisc / args
  ☆43Updated last year
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆33Updated 2 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆99Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆74Updated 4 months ago
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆16Updated 6 months ago
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆26Updated last year
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆19Updated last year
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆22Updated last year
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆20Updated last year
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆49Updated last year
• Linear95 / DSP
  Domain-specific preference (DSP) data and customized RM fine-tuning.
  ☆25Updated last year
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆123Updated 10 months ago
• tianjunz / TEMPERA
  ☆44Updated 2 years ago
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆58Updated last year
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated 2 years ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆94Updated last year
• dunzeng / MORE
  Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment
  ☆16Updated 11 months ago
• Linear95 / APO
  Code for ACL2024 paper - Adversarial Preference Optimization (APO).
  ☆55Updated last year
• LiuAmber / RAHF
  [ACL 2024 main] Aligning Large Language Models with Human Preferences through Representation Engineering (https://aclanthology.org/2024.…
  ☆25Updated 9 months ago
• GXimingLu / IPA
  Codebase for Inference-Time Policy Adapters
  ☆24Updated last year
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆77Updated 6 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆112Updated last year
• tatsu-lab / test_set_contamination
  ☆38Updated last year
• WANGXinyiLinda / concept-based-demonstration-selection
  Offical code of the paper Large Language Models Are Implicitly Topic Models: Explaining and Finding Good Demonstrations for In-Context Le…
  ☆75Updated last year
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆94Updated 3 years ago
• zlin7 / UQ-NLG
  ☆93Updated last year
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆60Updated 2 years ago
• activatedgeek / calibration-tuning
  ☆51Updated 3 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆58Updated 9 months ago