princeton-nlp / unintentional-unalignmentLinks
[ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
☆30Updated 7 months ago
Alternatives and similar repositories for unintentional-unalignment
Users that are interested in unintentional-unalignment are comparing it to the libraries listed below
Sorting:
- ☆44Updated last year
- ☆29Updated last year
- Lightweight Adapting for Black-Box Large Language Models☆23Updated last year
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆123Updated 11 months ago
- Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)☆36Updated 3 months ago
- Directional Preference Alignment☆59Updated 11 months ago
- Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"☆72Updated 2 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆76Updated 5 months ago
- ☆51Updated last year
- ☆52Updated 4 months ago
- ☆56Updated 3 months ago
- ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment☆58Updated last year
- ☆96Updated last year
- A Sober Look at Language Model Reasoning☆81Updated 2 months ago
- This is the official repo for Towards Uncertainty-Aware Language Agent.☆27Updated last year
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆63Updated 9 months ago
- Code for "Reasoning to Learn from Latent Thoughts"☆116Updated 4 months ago
- Implementation for the paper "The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning"☆91Updated last month
- ☆46Updated 2 years ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆44Updated 4 months ago
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆77Updated 2 years ago
- Offical code of the paper Large Language Models Are Implicitly Topic Models: Explaining and Finding Good Demonstrations for In-Context Le…☆75Updated last year
- ☆32Updated last year
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆85Updated last year
- Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging☆108Updated last year
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆79Updated 8 months ago
- Augmenting Statistical Models with Natural Language Parameters☆27Updated 11 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆177Updated 4 months ago
- ☆14Updated last month
- Active Example Selection for In-Context Learning (EMNLP'22)☆49Updated last year