VITA-Group / SEAL
Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free
☆20Updated last month
Alternatives and similar repositories for SEAL:
Users that are interested in SEAL are comparing it to the libraries listed below
- ☆21Updated last month
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆42Updated 5 months ago
- This is the official code for the paper "Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturba…☆25Updated last month
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆76Updated last month
- ☆29Updated 2 months ago
- SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities☆13Updated last month
- [NeurIPS 2024] "Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?"☆35Updated 3 months ago
- An effective weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study uncovering how reasoning length…☆10Updated this week
- ☆36Updated 7 months ago
- Code for Fine-grained Uncertainty Quantification for LLMs from Semantic Similarities (NeurIPS'24)☆21Updated 4 months ago
- ☆58Updated 9 months ago
- This repo is for the safety topic, including attacks, defenses and studies related to reasoning and RL☆17Updated last week
- Model merging is a highly efficient approach for long-to-short reasoning.☆46Updated last month
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆22Updated 9 months ago
- Language Imbalance Driven Rewarding for Multilingual Self-improving☆17Updated 6 months ago
- Official repo for EMNLP'24 paper "SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning"☆24Updated 7 months ago
- ☆29Updated last year
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆110Updated 2 weeks ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆57Updated last year
- ☆18Updated last month
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆44Updated 6 months ago
- ☆23Updated 7 months ago
- ☆59Updated 3 weeks ago
- ☆49Updated last year
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆64Updated 7 months ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆58Updated 2 months ago
- This is the official code for the paper "Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable".☆15Updated last month
- [NeurIPS 2024] How do Large Language Models Handle Multilingualism?☆33Updated 6 months ago
- This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)☆20Updated 7 months ago
- Codebase for decoding compressed trust.☆23Updated last year