XuandongZhao / weak-to-strong

Related projects: ⓘ

• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆79Updated 3 months ago
• chujiezheng / LLM-Safeguard
  Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"
  ☆64Updated 2 weeks ago
• OSU-NLP-Group / AmpleGCG
  AmpleGCG: Learning a Universal and Transferable Generator of Adversarial Attacks on Both Open and Closed LLM
  ☆33Updated 3 weeks ago
• ejones313 / auditing-llms
  ☆47Updated last year
• OpenSafetyLab / SALAD-BENCH
  【ACL 2024】 SALAD benchmark & MD-Judge
  ☆81Updated this week
• Princeton-SysML / Jailbreak_LLM
  ☆143Updated 9 months ago
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆89Updated 2 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆76Updated 6 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆48Updated 6 months ago
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆61Updated 4 months ago
• paul-rottger / exaggerated-safety
  Röttger et al. (2023): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆55Updated 8 months ago
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆84Updated 5 months ago
• YihanWang617 / LLM-Jailbreaking-Defense-Backtranslation
  Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"
  ☆20Updated last month
• GAIR-NLP / weak-to-strong-reasoning
  ☆46Updated 2 weeks ago
• centerforaisafety / wmdp
  WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…
  ☆72Updated 4 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆37Updated 10 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆46Updated last month
• Lordog / R-Judge
  R-Judge: Benchmarking Safety Risk Awareness for LLM Agents
  ☆57Updated last month
• lyy1994 / awesome-data-contamination
  The Paper List on Data Contamination for Large Language Models Evaluation.
  ☆46Updated this week
• Improbable-AI / curiosity_redteam
  Official implementation of ICLR'24 paper, "Curiosity-driven Red Teaming for Large Language Models" (https://openreview.net/pdf?id=4KqkizX…
  ☆57Updated 6 months ago
• facebookresearch / advprompter
  Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873
  ☆110Updated 4 months ago
• tatsu-lab / test_set_contamination
  ☆32Updated 10 months ago
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆124Updated 2 months ago
• thestephencasper / explore_establish_exploit_llms
  ☆30Updated last year
• chrisliu298 / awesome-representation-engineering
  A resource repository for representation engineering in large language models
  ☆36Updated last week
• zhxieml / remiss-jailbreak
  ☆20Updated 2 months ago
• ydyjya / LLM-IHS-Explanation
  ☆27Updated 3 months ago
• hkust-nlp / Activation_Decoding
  ☆42Updated 5 months ago
• DAMO-NLP-SG / multilingual-safety-for-LLMs
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
  ☆50Updated 6 months ago
• boyiwei / alignment-attribution-code
  Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
  ☆55Updated 2 months ago