Alternatives and similar repositories for relative-preference-optimization:

Users that are interested in relative-preference-optimization are comparing it to the libraries listed below

• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆42Updated 6 months ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆63Updated 3 weeks ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆54Updated 2 months ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆23Updated 4 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆58Updated last month
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆63Updated 3 months ago
• OpenSparseLLMs / LLaMA-MoE-v2
  🚀LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
  ☆69Updated 2 months ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆53Updated 2 months ago
• tianyi-lab / Mosaic-IT
  Mosaic IT: Enhancing Instruction Tuning with Data Mosaics
  ☆17Updated last week
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆33Updated 3 months ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆42Updated 3 months ago
• ZHZisZZ / modpo
  [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
  ☆66Updated 6 months ago
• facebookresearch / RLCD
  Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment
  ☆66Updated last year
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆39Updated 3 months ago
• vlf-silkie / VLFeedback
  ☆94Updated last year
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆65Updated last year
• hbin0701 / Self-Explore
  [EMNLP Findings 2024 & ACL 2024 NLRSE Oral] Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards
  ☆48Updated 9 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆68Updated 8 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆63Updated 8 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆49Updated 4 months ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆48Updated 2 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆35Updated 4 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆56Updated 4 months ago
• adymaharana / d2pruning
  ☆32Updated last year
• hkust-nlp / mstar
  M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆55Updated last month
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆23Updated 4 months ago
• kaistAI / Volcano
  [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…
  ☆43Updated 6 months ago
• lucywang720 / model-surgery
  ☆28Updated 3 months ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆45Updated 3 months ago
• GAIR-NLP / self-improvement-reversal
  ☆13Updated 7 months ago