LostOxygen / llm-confidentiality

Related projects ⓘ

Alternatives and complementary repositories for llm-confidentiality

• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆46Updated 3 months ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆41Updated last month
• ZiyueWang25 / llm-security-challenge
  Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…
  ☆11Updated last year
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆64Updated 9 months ago
• andyzoujm / breaking-llama-guard
  Code to break Llama Guard
  ☆30Updated 11 months ago
• andyzorigin / cybench
  ☆63Updated this week
• OSU-NLP-Group / AmpleGCG
  AmpleGCG: Learning a Universal and Transferable Generator of Adversarial Attacks on Both Open and Closed LLM
  ☆45Updated 2 weeks ago
• ebagdasa / multimodal_injection
  ☆72Updated last year
• hupe1980 / aisploit
  🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
  ☆16Updated 6 months ago
• poloclub / llm-self-defense
  LLM Self Defense: By Self Examination, LLMs know they are being tricked
  ☆27Updated 6 months ago
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆65Updated this week
• facebookresearch / SecAlign
  Repo for the research paper "Aligning LLMs to Be Robust Against Prompt Injection"
  ☆19Updated 3 weeks ago
• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆73Updated 6 months ago
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆220Updated 2 months ago
• XuandongZhao / weak-to-strong
  Weak-to-Strong Jailbreaking on Large Language Models
  ☆67Updated 9 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆107Updated 8 months ago
• HumanCompatibleAI / tensor-trust
  A prompt injection game to collect data for robust ML research
  ☆44Updated last month
• TrustAIResearch / MLHospital
  ☆43Updated last year
• xirui-li / DrAttack
  Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers
  ☆36Updated 2 months ago
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆34Updated 3 weeks ago
• HumanCompatibleAI / tensor-trust-data
  Dataset for the Tensor Trust project
  ☆33Updated 8 months ago
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆78Updated last month
• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆110Updated 2 months ago
• azshue / AutoPoison
  The official repository of the paper "On the Exploitability of Instruction Tuning".
  ☆57Updated 9 months ago
• llm-platform-security / SecGPT
  SecGPT: An execution isolation architecture for LLM-based systems
  ☆49Updated 3 weeks ago
• Princeton-SysML / Jailbreak_LLM
  ☆153Updated 11 months ago
• BillChan226 / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆59Updated 3 months ago
• liu00222 / Open-Prompt-Injection
  This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
  ☆146Updated 2 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆84Updated 8 months ago
• microsoft / WaveCoder
  Advancing LLM with Diverse Coding Capabilities
  ☆51Updated 3 months ago