This repo is for the safety topic, including attacks, defenses and studies related to reasoning and RL
☆67Sep 5, 2025Updated last year
Alternatives and similar repositories for Awesome-reasoning-safety
Users that are interested in Awesome-reasoning-safety are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2024] Towards Elminating Hard Label Constraints in Gradient Inverision Attacks☆14Feb 6, 2024Updated 2 years ago
- Official code for ICML 2024 paper, "Connecting the Dots: Collaborative Fine-tuning for Black-Box Vision-Language Models"☆19Jun 12, 2024Updated 2 years ago
- [ICLR'26] Official Repository for The Paper: Stop Tracking Me! Proactive Defense Against Attribute Inference Attack in LLMs☆26Apr 6, 2026Updated 6 months ago
- [ACL'26] Official Repository for The Paper: What If Consensus Lies? Selective-Complementary Reinforcement Learning at Test Time☆21Apr 7, 2026Updated 6 months ago
- The official repository of ECCV 2024 paper "Outlier-Aware Test-time Adaptation with Stable Memory Replay"☆22Jun 8, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [NeurIPS 2025 Datasets & Benchmarks Track] The Illusion of Progress? A Critical Look at Test-Time Adaptation for Vision-Language Models☆40Oct 26, 2025Updated 11 months ago
- Official code for ICLR 2026 Oral paper, "Taming Momentum: Rethinking Optimizer States Through Low-Rank Approximation"☆37Feb 26, 2026Updated 7 months ago
- ICCV 2023 - AdaptGuard: Defending Against Universal Attacks for Model Adaptation☆11Dec 23, 2023Updated 2 years ago
- CVPR 2025 - R-TPT: Improving Adversarial Robustness of Vision-Language Models through Test-Time Prompt Tuning☆22Aug 28, 2025Updated last year
- A collection of model transferability estimation methods.☆34Oct 12, 2024Updated last year
- ☆65Apr 10, 2024Updated 2 years ago
- This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)☆28Sep 10, 2024Updated 2 years ago
- ICML-2024 highlight paper "Realistic Unsupervised CLIP Fine-tuning with Universal Entropy Optimization"☆20Jul 18, 2024Updated 2 years ago
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆53Jan 15, 2026Updated 8 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [NDSS'25] The official implementation of safety misalignment.☆19Jan 8, 2025Updated last year
- Awesome Large Reasoning Model(LRM) Safety.This repository is used to collect security-related research on large reasoning models such as …☆84Oct 2, 2026Updated last week
- This is the official code for the paper "Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturba…☆43Mar 22, 2025Updated last year
- NN 2023☆23Nov 9, 2022Updated 3 years ago
- Official code for ICCV 2023 paper, "Improving Zero-Shot Generalization for CLIP with Synthesized Prompts"☆103Mar 6, 2024Updated 2 years ago
- ☆16Feb 26, 2025Updated last year
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆150Apr 8, 2025Updated last year
- [NAACL 2025 Main] Official implementation of "From Allies to Adversaries: Manipulating LLM Tool Scheduling through Adversarial Injection"…☆23Jun 11, 2025Updated last year
- [EMNLP 2025] Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignment☆17Jul 22, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Fingerprint large language models☆51Jul 11, 2024Updated 2 years ago
- Official repository for "Safety in Large Reasoning Models: A Survey" - Exploring safety risks, attacks, and defenses for Large Reasoning …☆90Aug 25, 2025Updated last year
- [ACL 2023 findings] Towards Robust Personalized Dialogue Generation via Order-Insensitive Representation Regularization☆17Aug 26, 2023Updated 3 years ago
- ☆15Jan 20, 2026Updated 8 months ago
- This is the repository that introduces research topics related to protecting intellectual property (IP) of AI from a data-centric perspec…☆23Oct 30, 2023Updated 2 years ago
- [AAAI'26 Oral] Official Implementation of STAR-1: Safer Alignment of Reasoning LLMs with 1K Data☆39Apr 7, 2025Updated last year
- ☆24Feb 17, 2026Updated 7 months ago
- [ICLR 2025] On Evluating the Durability of Safegurads for Open-Weight LLMs☆13Jun 20, 2025Updated last year
- [NeurIPS 2026] ReasoningShield: Safety Detection over Reasoning Traces of Large Reasoning Models☆27Sep 27, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 🦞 Research-oriented collection of papers, analyses & resources on the OpenClaw ecosystem☆340Jul 5, 2026Updated 3 months ago
- A survey on harmful fine-tuning attack for large language model (ACM CSUR)☆248Sep 6, 2026Updated last month
- [ICLR 2025] FLAT: LLM Unlearning via Loss Adjustment with Only Forget Data☆14Feb 26, 2025Updated last year
- ☆18Oct 7, 2022Updated 4 years ago
- Official Repo of Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents☆99Jun 2, 2026Updated 4 months ago
- Collection of Unsupervised Learning Methods for Vision-Language Models (VLMs)☆97Jul 27, 2026Updated 2 months ago
- ☆24Dec 8, 2024Updated last year