jamqd / Group-Preference-OptimizationLinks
☆20Updated last year
Alternatives and similar repositories for Group-Preference-Optimization
Users that are interested in Group-Preference-Optimization are comparing it to the libraries listed below
Sorting:
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆78Updated 6 months ago
- ☆174Updated last year
- Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"☆73Updated 3 months ago
- ☆44Updated last year
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆84Updated 5 months ago
- RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024☆82Updated 11 months ago
- ☆41Updated 11 months ago
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆31Updated last year
- Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".☆25Updated 10 months ago
- ☆29Updated last year
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆76Updated 11 months ago
- ☆60Updated last year
- Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)☆26Updated last year
- ☆62Updated 6 months ago
- LLM Unlearning☆174Updated last year
- ☆97Updated last year
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆61Updated last year
- ☆100Updated last year
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆34Updated 7 months ago
- ☆27Updated 6 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆118Updated last year
- A resource repository for representation engineering in large language models☆136Updated 10 months ago
- ☆55Updated 2 years ago
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆87Updated last year
- [NeurIPS 2024] "Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?"☆37Updated 2 months ago
- ☆51Updated last year
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆63Updated 9 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆80Updated 9 months ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆43Updated 10 months ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆111Updated 6 months ago