[ICLR 2025] On Evluating the Durability of Safegurads for Open-Weight LLMs
☆13Jun 20, 2025Updated last year
Alternatives and similar repositories for Evaluating-Durable-Safeguards
Users that are interested in Evaluating-Durable-Safeguards are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆24Dec 8, 2024Updated last year
- [NeurIPS 2024 D&B] Evaluating Copyright Takedown Methods for Language Models☆17Jul 17, 2024Updated 2 years ago
- ☆14Jun 25, 2024Updated 2 years ago
- Code for Spectral Insights into Data-Oblivious Critical Layers in Large Language Models.☆11Jun 17, 2025Updated last year
- Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆86Mar 1, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [NeurIPS'24] "NeuralFuse: Learning to Recover the Accuracy of Access-Limited Neural Network Inference in Low-Voltage Regimes" by Hao-Lun …☆10Sep 18, 2025Updated last year
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆91Mar 30, 2025Updated last year
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆71Jun 9, 2025Updated last year
- ☆49Oct 1, 2024Updated 2 years ago
- Code to replicate the Representation Noising paper and tools for evaluating defences against harmful fine-tuning☆25Dec 12, 2024Updated last year
- ☆11Jul 8, 2025Updated last year
- ☆10Oct 31, 2022Updated 4 years ago
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆54Jan 15, 2026Updated 9 months ago
- Code for SafeMERGE (ACL 2026).☆15Oct 2, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This is the official code for the paper "Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable".☆36Mar 11, 2025Updated last year
- How Robust are Randomized Smoothing based Defenses to Data Poisoning? (CVPR 2021)☆14Jul 16, 2021Updated 5 years ago
- Code for our paper "Localizing Lying in Llama"☆15Apr 24, 2025Updated last year
- [NeurIPS 2023] Differentially Private Image Classification by Learning Priors from Random Processes☆12Jun 12, 2023Updated 3 years ago
- ☆43May 21, 2025Updated last year
- Your finetuned model's back to its original safety standards faster than you can say "SafetyLock"!☆11Oct 16, 2024Updated 2 years ago
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆194Apr 23, 2025Updated last year
- [EMNLP 2025] Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignment☆17Jul 22, 2025Updated last year
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆51Oct 10, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆22Sep 21, 2025Updated last year
- ☆20Jun 21, 2025Updated last year
- [ICLR24] "AutoVP: An Automated Visual Prompting Framework and Benchmark" by Hsi-Ai Tsao*, Lei Hsiung*, Pin-Yu Chen, Sijia Liu, and Tsung-…☆24Sep 18, 2025Updated last year
- ☆50Oct 24, 2023Updated 3 years ago
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆18Apr 15, 2025Updated last year
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆361Feb 23, 2024Updated 2 years ago
- https://scale.com/research/mrt☆21Mar 16, 2026Updated 7 months ago
- Code Repository for the Paper ---Revisiting the Assumption of Latent Separability for Backdoor Defenses (ICLR 2023)☆48Feb 28, 2023Updated 3 years ago
- Auditing agents for fine-tuning safety☆22Oct 21, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- [CVPR23] "Towards Compositional Adversarial Robustness: Generalizing Adversarial Training to Composite Semantic Perturbations" by Lei Hsi…☆23Sep 14, 2026Updated last month
- This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)☆30Sep 10, 2024Updated 2 years ago
- Improving Alignment and Robustness with Circuit Breakers☆271Sep 24, 2024Updated 2 years ago
- A challenge to investigate the security of the InstaHide protocol.☆12Dec 7, 2020Updated 5 years ago
- Code repository for the paper --- [USENIX Security 2023] Towards A Proactive ML Approach for Detecting Backdoor Poison Samples☆31Jul 11, 2023Updated 3 years ago
- Code to break Llama Guard☆32Dec 7, 2023Updated 2 years ago
- Debiasing Through Data Attribution☆13May 23, 2024Updated 2 years ago