Alternatives and similar repositories for latent-jailbreak:

Users that are interested in latent-jailbreak are comparing it to the libraries listed below

• Lordog / R-Judge
  R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)
  ☆68Updated last month
• DAMO-NLP-SG / multilingual-safety-for-LLMs
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
  ☆69Updated last year
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆89Updated 10 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆95Updated last year
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆66Updated 2 years ago
• ToolBeHonest / ToolBeHonest
  [EMNLP 2024] A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models.
  ☆17Updated 6 months ago
• Re-Align / just-eval
  A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.
  ☆85Updated last year
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆78Updated 10 months ago
• penguinnnnn / awesome-llm-and-society
  Recent papers on (1) Psychology of LLMs; (2) Biases in LLMs.
  ☆47Updated last year
• thu-coai / Targeted-Data-Extraction
  Official Code for ACL 2023 paper: "Ethicist: Targeted Training Data Extraction Through Loss Smoothed Soft Prompting and Calibrated Confid…
  ☆22Updated last year
• chujiezheng / LLM-Safeguard
  Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"
  ☆88Updated 6 months ago
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆63Updated last year
• SALT-NLP / chain-of-thought-bias
  ☆25Updated 6 months ago
• liyucheng09 / Contamination_Detector
  Lightweight tool to identify Data Contamination in LLMs evaluation
  ☆49Updated last year
• XuandongZhao / weak-to-strong
  Weak-to-Strong Jailbreaking on Large Language Models
  ☆72Updated last year
• hongbinye / Cognitive-Mirage-Hallucinations-in-LLMs
  Repository for the paper "Cognitive Mirage: A Review of Hallucinations in Large Language Models"
  ☆47Updated last year
• Princeton-SysML / kNNLM_privacy
  Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888
  ☆35Updated 9 months ago
• OpenSafetyLab / SALAD-BENCH
  【ACL 2024】 SALAD benchmark & MD-Judge
  ☆134Updated 3 weeks ago
• halfrot / ALaRM
  [ACL 2024] Code for the paper "ALaRM: Align Language Models via Hierarchical Rewards Modeling"
  ☆25Updated last year
• tatsu-lab / test_set_contamination
  ☆37Updated last year
• AI21Labs / factor
  Code and data for the FACTOR paper
  ☆44Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 6 months ago
• YihanWang617 / llm-jailbreaking-defense
  A lightweight library for large laguage model (LLM) jailbreaking defense.
  ☆48Updated 5 months ago
• BeyonderXX / ShadowAlignment
  Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models
  ☆27Updated last year
• yinzhangyue / SelfAware
  Do Large Language Models Know What They Don’t Know?
  ☆92Updated 4 months ago
• xirui-li / DrAttack
  Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers
  ☆51Updated 7 months ago
• llm-misinformation / llm-misinformation
  The dataset and code for the ICLR 2024 paper "Can LLM-Generated Misinformation Be Detected?"
  ☆56Updated 4 months ago
• AI45Lab / ActorAttack
  ☆80Updated last month
• IS2Lab / S-Eval
  S-Eval: Automatic and Adaptive Test Generation for Benchmarking Safety Evaluation of Large Language Models
  ☆55Updated last month
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆64Updated 6 months ago