vfleaking / PTST

Related projects: ⓘ

• git-disl / Vaccine
  This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models"
  ☆12Updated last week
• ejones313 / auditing-llms
  ☆47Updated last year
• Unispac / shallow-vs-deep-alignment
  Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep
  ☆22Updated 2 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆37Updated 10 months ago
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NextGenAISafety @ ICML 2024)
  ☆37Updated last month
• zhaoyiran924 / Probe-Sampling
  Code of paper "Accelerating Greedy Coordinate Gradient via Probe Sampling"
  ☆16Updated 5 months ago
• licong-lin / negative-preference-optimization
  ☆21Updated 2 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆79Updated 3 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆46Updated last month
• zhxieml / remiss-jailbreak
  ☆20Updated 2 months ago
• locuslab / acr-memorization
  ☆23Updated 4 months ago
• VITA-Group / Robust_Weight_Signatures
  [ICML 2023] "Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights?" by Ruisi Cai, Zhenyu Zhang, Zhangyang Wang
  ☆16Updated last year
• paul-rottger / exaggerated-safety
  Röttger et al. (2023): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆55Updated 8 months ago
• princeton-nlp / benign-data-breaks-safety
  ☆12Updated 3 months ago
• locuslab / tofu
  Landing Page for TOFU
  ☆79Updated 3 months ago
• thestephencasper / explore_establish_exploit_llms
  ☆30Updated last year
• rishub-tamirisa / tamper-resistance
  Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"
  ☆34Updated 3 weeks ago
• boyiwei / alignment-attribution-code
  Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
  ☆55Updated 2 months ago
• ykwon0407 / DataInf
  DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)
  ☆48Updated 5 months ago
• JasonForJoy / Model-Editing-Hurt
  Model Editing Can Hurt General Abilities of Large Language Models
  ☆29Updated 7 months ago
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆20Updated 4 months ago
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆12Updated 4 months ago
• renqibing / CodeAttack
  [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion
  ☆14Updated this week
• OSU-NLP-Group / AmpleGCG
  AmpleGCG: Learning a Universal and Transferable Generator of Adversarial Attacks on Both Open and Closed LLM
  ☆33Updated 3 weeks ago
• ChenWu98 / agent-attack
  [Arxiv 2024] Adversarial attacks on multimodal agents
  ☆33Updated 2 months ago
• chujiezheng / LLM-Safeguard
  Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"
  ☆64Updated 2 weeks ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆22Updated 5 months ago
• yihuaihong / ConceptVectors
  ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"
  ☆14Updated 2 weeks ago
• centerforaisafety / tdc2023-starter-kit
  This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.
  ☆77Updated 4 months ago
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆27Updated 3 months ago