An implementation of SEAL: Safety-Enhanced Aligned LLM fine-tuning via bilevel data selection.
☆24Feb 20, 2025Updated last year
Alternatives and similar repositories for SEAL
Users that are interested in SEAL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official PyTorch implementation of ALRIGHT and MAXRIGHT algorithms for efficient trade-off in LLM post-training☆13Nov 11, 2025Updated 11 months ago
- An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.☆20Feb 13, 2023Updated 3 years ago
- This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)☆30Sep 10, 2024Updated 2 years ago
- Code of Annotation-Efficient Language Model Alignment via Diverse and Representative Response Texts (EMNLP Findings 2025)☆10May 29, 2024Updated 2 years ago
- Official implementation for "ALI-Agent: Assessing LLMs'Alignment with Human Values via Agent-based Evaluation"☆21Jan 31, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is the unofficial re-implementation of "Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-t…☆13Jul 14, 2025Updated last year
- (ICLR '26) Safety Subspaces are Not Linearly Distinct: A Fine-Tuning Case Study☆12Oct 4, 2025Updated last year
- Implement of our TKDE paper: Hyperbolic Graph Learning for Social Recommendation☆13Jun 3, 2024Updated 2 years ago
- [EMNLP 2025] Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignment☆17Jul 22, 2025Updated last year
- This is the official code for the paper "Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable".☆36Mar 11, 2025Updated last year
- Code for paper "Concrete Subspace Learning based Interference Elimination for Multi-task Model Fusion"☆14Mar 28, 2024Updated 2 years ago
- [ICLR 2025] Official code of "Towards Robust Alignment of Language Models: Distributionally Robustifying Direct Preference Optimization"☆18Jun 1, 2024Updated 2 years ago
- This is the official code for the paper "Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturba…☆43Mar 22, 2025Updated last year
- ☆49Oct 1, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for paper "Byzantine-Resilient Decentralized Stochastic Optimization with Robust Aggregation Rules"☆21Apr 19, 2024Updated 2 years ago
- This is the official code for the paper "Virus: Harmful Fine-tuning Attack for Large Language Models Bypassing Guardrail Moderation"☆56Feb 2, 2025Updated last year
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆54Jan 15, 2026Updated 9 months ago
- [NeurIPS 2025] Panacea: Mitigating Harmful Fine-tuning for Large Language Models via Post-fine-tuning Perturbation.☆14Jul 28, 2026Updated 3 months ago
- ☆14Oct 7, 2023Updated 3 years ago
- ☆21Dec 26, 2024Updated last year
- Github repo for NeurIPS 2024 paper "Safe LoRA: the Silver Lining of Reducing Safety Risks when Fine-tuning Large Language Models"☆32Dec 21, 2025Updated 10 months ago
- A survey on harmful fine-tuning attack for large language model (ACM CSUR)☆254Sep 6, 2026Updated last month
- Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learning☆34Feb 7, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Toolkit to benchmark the tamper-resistance of LLMs.☆35May 15, 2026Updated 5 months ago
- Code for the paper "AsFT: Anchoring Safety During LLM Fune-Tuning Within Narrow Safety Basin".☆38Jul 10, 2025Updated last year
- code space of paper "Safety Layers in Aligned Large Language Models: The Key to LLM Security" (ICLR 2025)☆27Apr 26, 2025Updated last year
- Tensorflow implementation of our SIGIR 2023 accepted paper "Generative-Contrastive Graph Learning for Recommendation"☆31Aug 26, 2024Updated 2 years ago
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆22Sep 21, 2025Updated last year
- This is the official implementation of ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting☆25Jul 30, 2024Updated 2 years ago
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆194Apr 23, 2025Updated last year
- Official code repository for the paper "Internal Activation as the Polar Star for Steering Unsafe LLM Behavior"☆16May 31, 2026Updated 5 months ago
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆361Feb 23, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆71Jun 9, 2025Updated last year
- The official code repo for "Safe Delta: Consistently Preserving Safety when Fine-Tuning LLMs on Diverse Datasets" in ICML 2025.☆59Feb 12, 2026Updated 8 months ago
- Repo for EmbedLLM: Learning Compact Representations of Large Language Models☆34Sep 25, 2025Updated last year
- Code of NeurIPS 2019 paper: Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradients☆16May 13, 2020Updated 6 years ago
- ☆24Dec 8, 2024Updated last year
- Reference implementation for DPO (Direct Preference Optimization)☆13Jan 18, 2024Updated 2 years ago
- Rad-cGAN v1.0: Radar-based precipitation nowcasting model with conditional Generative Adversarial Networks for multiple dam domains☆11Jul 22, 2022Updated 4 years ago