This repo is for the safety topic, including attacks, defenses and studies related to reasoning and RL
☆66Sep 5, 2025Updated last year
Alternatives and similar repositories for Awesome-reasoning-safety
Users that are interested in Awesome-reasoning-safety are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2024] Towards Elminating Hard Label Constraints in Gradient Inverision Attacks☆14Feb 6, 2024Updated 2 years ago
- Official code for ICML 2024 paper, "Connecting the Dots: Collaborative Fine-tuning for Black-Box Vision-Language Models"☆19Jun 12, 2024Updated 2 years ago
- The official repository of ECCV 2024 paper "Outlier-Aware Test-time Adaptation with Stable Memory Replay"☆22Jun 8, 2025Updated last year
- [ACL'26] Official Repository for The Paper: What If Consensus Lies? Selective-Complementary Reinforcement Learning at Test Time☆23Apr 7, 2026Updated 7 months ago
- [NeurIPS 2025 Datasets & Benchmarks Track] The Illusion of Progress? A Critical Look at Test-Time Adaptation for Vision-Language Models☆42Oct 26, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ICCV 2023 - AdaptGuard: Defending Against Universal Attacks for Model Adaptation☆11Dec 23, 2023Updated 2 years ago
- Official code for ICLR 2024 paper, "A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation"☆85Apr 21, 2024Updated 2 years ago
- CVPR 2025 - R-TPT: Improving Adversarial Robustness of Vision-Language Models through Test-Time Prompt Tuning☆23Aug 28, 2025Updated last year
- ICML-2024 highlight paper "Realistic Unsupervised CLIP Fine-tuning with Universal Entropy Optimization"☆20Jul 18, 2024Updated 2 years ago
- ☆65Apr 10, 2024Updated 2 years ago
- Awesome Large Reasoning Model(LRM) Safety.This repository is used to collect security-related research on large reasoning models such as …☆84Updated this week
- ☆11Jul 3, 2024Updated 2 years ago
- A collection of model transferability estimation methods.☆35Oct 12, 2024Updated 2 years ago
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆54Jan 15, 2026Updated 10 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)☆30Sep 10, 2024Updated 2 years ago
- [EMNLP 2025] Reasoning-to-Defend: Safety-Aware Reasoning Can Defend Large Language Models from Jailbreaking☆12Aug 22, 2025Updated last year
- [NDSS'25] The official implementation of safety misalignment.☆20Jan 8, 2025Updated last year
- This is the official code for the paper "Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturba…☆43Mar 22, 2025Updated last year
- NN 2023☆23Nov 9, 2022Updated 4 years ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆150Apr 8, 2025Updated last year
- Official code for ICCV 2023 paper, "Improving Zero-Shot Generalization for CLIP with Synthesized Prompts"☆103Mar 6, 2024Updated 2 years ago
- ☆16Feb 26, 2025Updated last year
- [ACL'25] SocialEval: Evaluating Social Intelligence of Large Language Models☆12Oct 20, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official implementation of “Contextual Image Attack: How Visual Context Exposes Multimodal Safety Vulnerabilities”☆11Apr 1, 2026Updated 7 months ago
- Fingerprint large language models☆52Jul 11, 2024Updated 2 years ago
- [EMNLP 2025] Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignment☆17Jul 22, 2025Updated last year
- [ICML 2025] Vulnerability-Aware Alignment: Mitigating Uneven Forgetting in Harmful Fine-Tuning☆12Jun 10, 2025Updated last year
- [CVPR'26] SafeGRPO: Self-Rewarded Multimodal Safety Alignment via Rule-Governed Policy Optimization☆23Feb 19, 2026Updated 9 months ago
- Official repository for "Safety in Large Reasoning Models: A Survey" - Exploring safety risks, attacks, and defenses for Large Reasoning …☆90Aug 25, 2025Updated last year
- This is the repository that introduces research topics related to protecting intellectual property (IP) of AI from a data-centric perspec…☆23Oct 30, 2023Updated 3 years ago
- ☆15Jan 20, 2026Updated 9 months ago
- [ACL 2023 findings] Towards Robust Personalized Dialogue Generation via Order-Insensitive Representation Regularization☆17Aug 26, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [AAAI'26 Oral] Official Implementation of STAR-1: Safer Alignment of Reasoning LLMs with 1K Data☆38Apr 7, 2025Updated last year
- [NAACL 2025 Main] Official implementation of "From Allies to Adversaries: Manipulating LLM Tool Scheduling through Adversarial Injection"…☆23Jun 11, 2025Updated last year
- 🦞 Research-oriented collection of papers, analyses & resources on the OpenClaw ecosystem☆341Jul 5, 2026Updated 4 months ago
- ☆18Oct 7, 2022Updated 4 years ago
- A survey on harmful fine-tuning attack for large language model (ACM CSUR)☆256Sep 6, 2026Updated 2 months ago
- Risk-Sensitive GRPO algorithm (ICLR2026)☆14Sep 30, 2025Updated last year
- Repo for HAICOSYSTEM☆14Jun 1, 2025Updated last year
Are these results useful?