Alternatives and similar repositories for jpo

Users that are interested in jpo are comparing it to the libraries listed below

• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• princeton-nlp / unintentional-unalignment
  [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆31Updated 7 months ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆21Updated last year
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• keven980716 / weak-to-strong-deception
  [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"
  ☆13Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆31Updated 7 months ago
• googleinterns / localizing-paragraph-memorization
  ☆14Updated last year
• SteveKGYang / MetaAligner
  Models, data, and codes for the paper: MetaAligner: Towards Generalizable Multi-Objective Alignment of Language Models
  ☆22Updated 11 months ago
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆37Updated 3 months ago
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆23Updated last year
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 4 months ago
• idanshen / Value-Augmented-Sampling
  ☆20Updated last year
• Pranjal2041 / AdaptiveConsistency
  Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs
  ☆39Updated last year
• qcznlp / uncertainty_attack
  ☆20Updated 11 months ago
• dqxiu / KAssess
  ☆14Updated last year
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆29Updated last year
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆28Updated 8 months ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆110Updated 2 years ago
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆16Updated 7 months ago
• SumilerGAO / SunGen
  ☆27Updated 2 years ago
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆27Updated last year
• UCSB-NLP-Chang / Prereq_tune
  Implementation for the paper "Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning"
  ☆10Updated 7 months ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆19Updated last year
• snu-mllab / Bayesian-Red-Teaming
  About Official PyTorch implementation of "Query-Efficient Black-Box Red Teaming via Bayesian Optimization" (ACL'23)
  ☆15Updated 2 years ago
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆40Updated 2 years ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated last year
• ychen-stat-ml / kernel-adapters
  Code for "Inducer-tuning: Connecting Prefix-tuning and Adapter-tuning" (EMNLP 2022) and "Empowering Parameter-Efficient Transfer Learning…
  ☆11Updated 2 years ago
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆28Updated last year
• deeplearning-wisc / args
  ☆44Updated last year
• kaistAI / knowledge-reasoning
  [EMNLP 2024] Official implementation of "Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Ut…
  ☆22Updated 8 months ago