Alternatives and similar repositories for chatgpt-plugin-eval

Users that are interested in chatgpt-plugin-eval are comparing it to the libraries listed below

• BHui97 / PLeak
  ☆61Updated 8 months ago
• facebookresearch / SecAlign
  Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"
  ☆66Updated last month
• LostOxygen / llm-confidentiality
  Whispers in the Machine: Confidentiality in Agentic Systems
  ☆40Updated 3 weeks ago
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆54Updated last year
• iliaishacked / sponge_examples
  ☆25Updated 3 years ago
• microsoft / analysing_pii_leakage
  The repository contains the code for analysing the leakage of personally identifiable (PII) information from the output of next word pred…
  ☆100Updated last year
• Sizhe-Chen / StruQ
  official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries
  ☆46Updated last month
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆89Updated 11 months ago
• SolidShen / BAIT
  🔥🔥🔥 Detecting hidden backdoors in Large Language Models with only black-box access
  ☆41Updated 3 months ago
• PurduePAML / Machine-Learning-Security-Seminar
  Machine Learning & Security Seminar @Purdue University
  ☆25Updated 2 years ago
• ZhangZhuoSJTU / LINT
  ☆16Updated last year
• agiresearch / ASB
  Agent Security Bench (ASB)
  ☆111Updated 2 months ago
• microsoft / TaskTracker
  TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…
  ☆64Updated 3 weeks ago
• uiuc-kang-lab / InjecAgent
  ☆71Updated last year
• wagner-group / prompt-injection-defense
  Fine-tuning base models to build robust task-specific models
  ☆32Updated last year
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆90Updated 7 months ago
• AI-secure / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆141Updated 4 months ago
• ThuCCSLab / JailbreakEval
  [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆167Updated 5 months ago
• eth-sri / sven
  ☆121Updated last year
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆73Updated last year
• surrealyz / verified-global-properties
  Learning Security Classifiers with Verified Global Robustness Properties (CCS'21) https://arxiv.org/pdf/2105.11363.pdf
  ☆27Updated 3 years ago
• SchwinnL / LLM_Embedding_Attack
  Code to conduct an embedding attack on LLMs
  ☆27Updated 7 months ago
• Kooscii / BadNets
  ☆98Updated 4 years ago
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆54Updated 10 months ago
• XHMY / AutoDefense
  AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks
  ☆53Updated 3 months ago
• xirui-li / DrAttack
  Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers
  ☆58Updated last year
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt Injection attacks and defenses
  ☆267Updated last month
• OSU-NLP-Group / AmpleGCG
  AmpleGCG: Learning a Universal and Transferable Generator of Adversarial Attacks on Both Open and Closed LLM
  ☆71Updated 10 months ago
• niuliang42 / CodexLeaks
  CodexLeaks: Privacy Leaks from Code Generation Language Models in GitHub Copilot
  ☆11Updated 2 years ago
• usail-hkust / JailTrickBench
  Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)
  ☆144Updated 9 months ago