LostOxygen / llm-confidentiality

Related projects: ⓘ

• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆45Updated last month
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆38Updated 5 months ago
• ZiyueWang25 / llm-security-challenge
  Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…
  ☆11Updated last year
• BillChan226 / AgentPoison
  Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆36Updated last month
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆181Updated last month
• liu00222 / Open-Prompt-Injection
  This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
  ☆125Updated 2 weeks ago
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆59Updated 6 months ago
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆48Updated last week
• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆84Updated this week
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆103Updated 6 months ago
• poloclub / llm-self-defense
  LLM Self Defense: By Self Examination, LLMs know they are being tricked
  ☆24Updated 3 months ago
• azshue / AutoPoison
  The official repository of the paper "On the Exploitability of Instruction Tuning".
  ☆56Updated 7 months ago
• andyzorigin / cybench
  ☆34Updated this week
• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆72Updated 4 months ago
• HumanCompatibleAI / tensor-trust
  A prompt injection game to collect data for robust ML research
  ☆39Updated 5 months ago
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆100Updated 3 months ago
• Babelscape / ALERT
  Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"
  ☆26Updated 2 months ago
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆24Updated 3 months ago
• microsoft / BIPIA
  A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
  ☆43Updated 5 months ago
• max-andr / adversarial-random-search-gpt4
  Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]
  ☆41Updated 4 months ago
• redwoodresearch / Text-Steganography-Benchmark
  Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.
  ☆13Updated 7 months ago
• ThuCCSLab / JailbreakEval
  A collection of automated evaluators for assessing jailbreak attempts.
  ☆55Updated 2 months ago
• llm-platform-security / chatgpt-plugin-eval
  LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins
  ☆24Updated last month
• XHMY / AutoDefense
  AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks
  ☆23Updated 3 months ago
• ebagdasa / multimodal_injection
  ☆59Updated 11 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆81Updated 6 months ago
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆27Updated 5 months ago
• AlignmentResearch / gpt-4-novel-apis-attacks
  ☆17Updated 8 months ago
• uw-nsl / ArtPrompt
  Official Repo of ACL 2024 Paper `ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMs`
  ☆36Updated 4 months ago
• OSU-NLP-Group / AmpleGCG
  AmpleGCG: Learning a Universal and Transferable Generator of Adversarial Attacks on Both Open and Closed LLM
  ☆33Updated 3 weeks ago