Alternatives and similar repositories for CPO:

Users that are interested in CPO are comparing it to the libraries listed below

• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆57Updated last year
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆43Updated 6 months ago
• YJiangcm / LTE
  [ACL 2024] Learning to Edit: Aligning LLMs with Knowledge Editing
  ☆35Updated 8 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆58Updated 4 months ago
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆63Updated last year
• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆24Updated last year
• ShuheSH / A-Survey-of-the-Reasoning-Abilities-of-LLMs
  ☆20Updated last month
• RUCAIBox / HaluEval-2.0
  ☆41Updated last year
• ADaM-BJTU / W2SG
  The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”
  ☆16Updated last year
• ChnQ / TracingLLM
  ☆25Updated 11 months ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆59Updated 9 months ago
• mathllm / Step-Controlled_DPO
  ☆22Updated 9 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆26Updated 4 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆80Updated last year
• sail-sg / ActivePRM
  ☆15Updated last week
• lfy79001 / S3Eval
  [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models
  ☆32Updated 10 months ago
• pillowsofwind / Course-Correction
  [EMNLP 2024] The official GitHub repo for the paper "Course-Correction: Safety Alignment Using Synthetic Preferences"
  ☆19Updated 6 months ago
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆20Updated 2 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 7 months ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆57Updated 4 months ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆29Updated last year
• Alsace08 / OOD-Math-Reasoning
  [NeurIPS 2024] Code and Data Repo for Paper "Embedding Trajectory for Out-of-Distribution Detection in Mathematical Reasoning"
  ☆25Updated 10 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆41Updated 6 months ago
• edenbiran / RippleEdits
  Evaluating the Ripple Effects of Knowledge Editing in Language Models
  ☆55Updated last year
• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆25Updated 6 months ago
• JasonForJoy / Model-Editing-Hurt
  EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
  ☆35Updated 5 months ago
• DYR1 / MoGU
  Our research proposes a novel MoGU framework that improves LLMs' safety while preserving their usability.
  ☆15Updated 3 months ago
• ChengpengLi1003 / DotaMath
  ☆29Updated 3 months ago
• RUCAIBox / CARP
  ☆17Updated last year