centerforaisafety / Intro_to_ML_SafetyLinks
☆74Updated 2 years ago
Alternatives and similar repositories for Intro_to_ML_Safety
Users that are interested in Intro_to_ML_Safety are comparing it to the libraries listed below
Sorting:
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆114Updated last year
- ☆34Updated last year
- Starter kit and data loading code for the Trojan Detection Challenge NeurIPS 2022 competition☆33Updated 2 years ago
- This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.☆90Updated last year
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆59Updated 2 months ago
- A fast, effective data attribution method for neural networks in PyTorch☆217Updated 9 months ago
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆18Updated 4 months ago
- Python package for measuring memorization in LLMs.☆164Updated last month
- Fluent student-teacher redteaming☆22Updated last year
- ☆42Updated 11 months ago
- ☆22Updated last year
- ☆57Updated 2 years ago
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆70Updated last year
- Repository for PURE: Turning Polysemantic Neurons Into Pure Features by Identifying Relevant Circuits, accepted at CVPR 2024 XAI4CV Works…☆19Updated last year
- ☆31Updated 2 years ago
- Improving Alignment and Robustness with Circuit Breakers☆228Updated 11 months ago
- Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]☆43Updated last year
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆135Updated 3 months ago
- Spurious Features Everywhere - Large-Scale Detection of Harmful Spurious Features in ImageNet☆32Updated 2 years ago
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆112Updated last year
- ☆32Updated 3 months ago
- ☆238Updated 11 months ago
- ☆295Updated 3 weeks ago
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆24Updated last year
- OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents☆27Updated last month
- Discount jupyter.☆51Updated 5 months ago
- ☆39Updated 9 months ago
- ☆12Updated 2 years ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆110Updated 6 months ago
- ☆184Updated last month