CaoYuanpu / BiPOLinks
Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization
☆33Updated last year
Alternatives and similar repositories for BiPO
Users that are interested in BiPO are comparing it to the libraries listed below
Sorting:
- A resource repository for representation engineering in large language models☆139Updated 11 months ago
 - [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆85Updated 7 months ago
 - Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆116Updated 8 months ago
 - Steering Llama 2 with Contrastive Activation Addition☆191Updated last year
 - A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆83Updated 7 months ago
 - ☆28Updated 7 months ago
 - [ICLR 2025] General-purpose activation steering library☆114Updated last month
 - ☆67Updated last year
 - This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆47Updated 11 months ago
 - ☆63Updated 7 months ago
 - Code for Representation Bending Paper☆12Updated 3 months ago
 - DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆76Updated last year
 - LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆98Updated 2 years ago
 - LLM Unlearning☆177Updated 2 years ago
 - ☆41Updated last year
 - Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"☆98Updated 5 months ago
 - Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆44Updated 6 months ago
 - This is the official code for the paper "Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable".☆26Updated 7 months ago
 - This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)☆23Updated last year
 - This repo is for the safety topic, including attacks, defenses and studies related to reasoning and RL☆48Updated last month
 - [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆66Updated 11 months ago
 - Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆160Updated 6 months ago
 - ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.☆87Updated last year
 - [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆62Updated 4 months ago
 - RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024☆85Updated last year
 - This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.☆89Updated last year
 - Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆64Updated 8 months ago
 - [NeurIPS 2024] How do Large Language Models Handle Multilingualism?☆42Updated 11 months ago
 - ☆21Updated last year
 - Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)☆26Updated last year