YangRui2015 / RiCLinks
Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"
☆78Updated 5 months ago
Alternatives and similar repositories for RiC
Users that are interested in RiC are comparing it to the libraries listed below
Sorting:
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆92Updated last year
- Rewarded soups official implementation☆62Updated 2 years ago
- Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".☆27Updated last year
- This my attempt to create Self-Correcting-LLM based on the paper Training Language Models to Self-Correct via Reinforcement Learning by g…☆37Updated 4 months ago
- ☆46Updated last year
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆149Updated 9 months ago
- [ACL'24, Outstanding Paper] Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!☆38Updated last year
- Code for NeurIPS 2024 paper "Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs"☆42Updated 8 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆83Updated 8 months ago
- An index of algorithms for reinforcement learning from human feedback (rlhf))☆92Updated last year
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆125Updated last year
- Principled Data Selection for Alignment: The Hidden Risks of Difficult Examples☆44Updated 4 months ago
- ☆54Updated last year
- official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…☆68Updated 7 months ago
- [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$☆49Updated last year
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆35Updated last year
- Directional Preference Alignment☆57Updated last year
- [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct☆190Updated 10 months ago
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆86Updated 7 months ago
- A repo for RLHF training and BoN over LLMs, with support for reward model ensembles.☆45Updated 10 months ago
- Direct preference optimization with f-divergences.☆14Updated last year
- A Sober Look at Language Model Reasoning☆87Updated last month
- [ICLR 2025] Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization☆31Updated 9 months ago
- AdaRFT: Efficient Reinforcement Finetuning via Adaptive Curriculum Learning☆47Updated 5 months ago
- ☆181Updated 6 months ago
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆47Updated last year
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆34Updated 9 months ago
- ☆21Updated last year
- Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging☆111Updated 2 years ago
- ☆51Updated last year