StavC / ComPromptMized

Related projects: ⓘ

• deadbits / vigil-llm
  ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
  ☆299Updated 7 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆116Updated 5 months ago
• haizelabs / get-haized
  A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.
  ☆77Updated 3 months ago
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆210Updated 3 months ago
• pdparchitect / llm-hacking-database
  This repository contains various attack against Large Language Models.
  ☆68Updated 3 months ago
• mrwadams / honeyagents
  HoneyAgents is a PoC demo of an AI-driven system that combines honeypots with autonomous AI agents to detect and mitigate cyber threats. …
  ☆34Updated 8 months ago
• dreadnode / rigging
  Lightweight LLM Interaction Framework
  ☆181Updated this week
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆80Updated last week
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆103Updated 6 months ago
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆310Updated 3 months ago
• WithSecureLabs / damn-vulnerable-llm-agent
  ☆164Updated 8 months ago
• forcesunseen / llm-hackers-handbook
  A guide to LLM hacking: fundamentals, prompt injection, offense, and defense
  ☆112Updated last year
• RiccardoBiosas / awesome-MLSecOps
  A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
  ☆220Updated last month
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆181Updated last month
• prompt-security / ps-fuzz
  Make your GenAI Apps Safe & Secure Test & harden your system prompt
  ☆360Updated last month
• usnistgov / dioptra
  Test Software for the Characterization of AI Technologies
  ☆212Updated this week
• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆218Updated 7 months ago
• harishsg993010 / DamnVulnerableLLMProject
  A LLM explicitly designed for getting hacked
  ☆121Updated last year
• protectai / modelscan
  Protection against Model Serialization Attacks
  ☆273Updated this week
• FonduAI / awesome-prompt-injection
  Learn about a type of vulnerability that specifically targets machine learning models
  ☆166Updated 3 months ago
• mik0w / pallms
  Payloads for Attacking Large Language Models
  ☆56Updated 2 months ago
• cybershujin / Threat-Actors-use-of-Artifical-Intelligence
  ☆158Updated last month
• dreadnode / parley
  Tree of Attacks (TAP) Jailbreaking Implementation
  ☆88Updated 7 months ago
• zmre / awesome-security-for-ai
  Awesome products for securing AI systems includes open source and commercial options and an infographic licensed CC-BY-SA-4.0.
  ☆45Updated 3 months ago
• safellama / plexiglass
  A toolkit for detecting and protecting against vulnerabilities in Large Language Models (LLMs).
  ☆116Updated 8 months ago
• CHATS-lab / persuasive_jailbreaker
  Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!
  ☆232Updated 5 months ago
• NickNameInvalid / LLM_CTF
  ☆58Updated 2 months ago
• sshh12 / llm_osint
  LLM OSINT is a proof-of-concept method of using LLMs to gather information from the internet and then perform a task with this informatio…
  ☆142Updated last month
• invariantlabs-ai / invariant
  A trace analysis tool for AI agents.
  ☆97Updated this week
• liu00222 / Open-Prompt-Injection
  This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
  ☆125Updated 2 weeks ago