Alternatives and similar repositories for research

Users that are interested in research are comparing it to the libraries listed below

• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆91Updated last year
• pasquini-dario / LLMmap
  ☆84Updated 3 months ago
• dreadnode / parley
  Tree of Attacks (TAP) Jailbreaking Implementation
  ☆115Updated last year
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆98Updated last year
• NickNameInvalid / LLM_CTF
  ☆65Updated 2 months ago
• BishopFox / BrokenHill
  A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)
  ☆145Updated 11 months ago
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆154Updated 5 months ago
• humane-intelligence / ai_village_defcon_grt_data
  ☆14Updated last year
• dreadnode / example-agents
  Example agents for the Dreadnode platform
  ☆19Updated this week
• RenatoGeh / advtok
  Adversarial Tokenization
  ☆34Updated 3 months ago
• parameterlab / trap
  Source code of "TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identification", ACL2024 (findings)
  ☆13Updated last year
• dreadnode / paperstack
  Arxiv + Notion Sync
  ☆20Updated 6 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆112Updated last year
• dreadnode / tensor-man
  A utility to inspect, validate, sign and verify machine learning model files.
  ☆60Updated 9 months ago
• HumanCompatibleAI / tensor-trust
  A prompt injection game to collect data for robust ML research
  ☆65Updated 9 months ago
• xsankar / AI-Red-Teaming
  All things specific to LLM Red Teaming Generative AI
  ☆29Updated last year
• reds-lab / BEEAR
  This is the official Gtihub repo for our paper: "BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Lang…
  ☆20Updated last year
• ebagdasa / multimodal_injection
  ☆95Updated 2 years ago
• HKU-TASR / Imperio
  [IJCAI 2024] Imperio is an LLM-powered backdoor attack. It allows the adversary to issue language-guided instructions to control the vict…
  ☆43Updated 9 months ago
• moohax / Charcuterie
  Data Scientists Go To Jupyter
  ☆67Updated 8 months ago
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆55Updated last year
• uiuc-kang-lab / InjecAgent
  ☆93Updated last year
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆61Updated last year
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt injection attacks and defenses
  ☆343Updated 3 weeks ago
• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆170Updated 11 months ago
• microsoft / TaskTracker
  TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…
  ☆75Updated 2 months ago
• google-research / camel-prompt-injection
  Code for the paper "Defeating Prompt Injections by Design"
  ☆150Updated 5 months ago
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆32Updated last year
• CryptoAILab / JailbreakEval
  [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆172Updated 7 months ago
• mik0w / pallms
  Payloads for Attacking Large Language Models
  ☆104Updated 5 months ago