Alternatives and similar repositories for jpo

Users that are interested in jpo are comparing it to the libraries listed below

• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆20Updated last year
• princeton-nlp / unintentional-unalignment
  [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
  ☆32Updated 3 weeks ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated 2 months ago
• idanshen / Value-Augmented-Sampling
  ☆20Updated last year
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• qcznlp / uncertainty_attack
  ☆22Updated 4 months ago
• dqxiu / KAssess
  ☆14Updated 2 years ago
• SumilerGAO / SunGen
  ☆27Updated 2 years ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆33Updated last year
• Pranjal2041 / AdaptiveConsistency
  Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs
  ☆40Updated 2 years ago
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆24Updated last year
• SteveKGYang / MetaAligner
  Models, data, and codes for the paper: MetaAligner: Towards Generalizable Multi-Objective Alignment of Language Models
  ☆24Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆32Updated last year
• tianyi-lab / Mosaic-IT
  [ACL'25] Mosaic-IT: Cost-Free Compositional Data Synthesis for Instruction Tuning
  ☆20Updated 4 months ago
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆31Updated last year
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆47Updated 9 months ago
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆17Updated last year
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆109Updated 2 years ago
• googleinterns / localizing-paragraph-memorization
  ☆15Updated last year
• kaistAI / knowledge-reasoning
  [EMNLP 2024] Official implementation of "Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Ut…
  ☆23Updated last year
• liziniu / GEM
  Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)
  ☆51Updated 8 months ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆30Updated last year
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆19Updated 2 years ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆33Updated 2 years ago
• zhang-yu-wei / InBedder
  Source code for InBedder, an instruction-following text embedder
  ☆30Updated last year
• INK-USC / ReCross
  ReCross: Unsupervised Cross-Task Generalization via Retrieval Augmentation
  ☆24Updated 3 years ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆36Updated last year
• Zce1112zslx / IKE
  ☆41Updated 2 years ago
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆51Updated last year
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated 2 years ago