Alternatives and similar repositories for jpo

Users that are interested in jpo are comparing it to the libraries listed below

• formll / resolving-scaling-law-discrepancies
  ☆20Updated 2 weeks ago
• princeton-nlp / unintentional-unalignment
  [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆31Updated 9 months ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆21Updated last year
• idanshen / Value-Augmented-Sampling
  ☆20Updated last year
• qcznlp / uncertainty_attack
  ☆21Updated 2 months ago
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆47Updated 6 months ago
• Pranjal2041 / AdaptiveConsistency
  Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs
  ☆39Updated last year
• dqxiu / KAssess
  ☆14Updated 2 years ago
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆40Updated 2 years ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 7 months ago
• OpenCausaLab / MORE
  ☆15Updated last year
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆16Updated 10 months ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated last year
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆30Updated last year
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆24Updated last year
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆57Updated last year
• kaistAI / knowledge-reasoning
  [EMNLP 2024] Official implementation of "Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Ut…
  ☆22Updated 11 months ago
• keven980716 / weak-to-strong-deception
  [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"
  ☆13Updated last year
• tianyi-lab / Mosaic-IT
  [ACL'25] Mosaic-IT: Cost-Free Compositional Data Synthesis for Instruction Tuning
  ☆20Updated last month
• tianjunz / TEMPERA
  ☆46Updated 2 years ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆51Updated last year
• SumilerGAO / SunGen
  ☆27Updated 2 years ago
• WANGXinyiLinda / concept-based-demonstration-selection
  Offical code of the paper Large Language Models Are Implicitly Topic Models: Explaining and Finding Good Demonstrations for In-Context Le…
  ☆75Updated last year
• KempnerInstitute / llm_uncertainty
  Code for the paper "Distinguishing the Knowable from the Unknowable with Language Models"
  ☆10Updated last year
• Jiuzhouh / Uncertainty-Aware-Language-Agent
  This is the official repo for Towards Uncertainty-Aware Language Agent.
  ☆29Updated last year
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆20Updated 2 years ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆33Updated 2 years ago
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆27Updated last year