Alternatives and similar repositories for chatgpt-plugin-eval

Users that are interested in chatgpt-plugin-eval are comparing it to the libraries listed below

• SolidShen / BAIT
  🔥🔥🔥 Detecting hidden backdoors in Large Language Models with only black-box access
  ☆50Updated 6 months ago
• BHui97 / PLeak
  ☆73Updated last year
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆100Updated 10 months ago
• CryptoAILab / JailbreakEval
  [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆176Updated 8 months ago
• usail-hkust / JailTrickBench
  Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)
  ☆156Updated last year
• iliaishacked / sponge_examples
  ☆25Updated 4 years ago
• HKUST-KnowComp / GEIA
  Code for Findings-ACL 2023 paper: Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Rec…
  ☆48Updated last year
• facebookresearch / SecAlign
  Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"
  ☆76Updated 4 months ago
• LostOxygen / llm-confidentiality
  Whispers in the Machine: Confidentiality in Agentic Systems
  ☆41Updated last week
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆75Updated last year
• Sizhe-Chen / StruQ
  official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries
  ☆55Updated last month
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆52Updated last year
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆55Updated last year
• microsoft / analysing_pii_leakage
  The repository contains the code for analysing the leakage of personally identifiable (PII) information from the output of next word pred…
  ☆101Updated last year
• shreyansh26 / Extracting-Training-Data-from-Large-Langauge-Models
  A re-implementation of the "Extracting Training Data from Large Language Models" paper by Carlini et al., 2020
  ☆37Updated 3 years ago
• reza321 / T-Miner
  ☆19Updated last year
• xirui-li / DrAttack
  Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers
  ☆66Updated last year
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆102Updated last year
• uiuc-kang-lab / InjecAgent
  ☆99Updated last year
• arobey1 / smooth-llm
  ☆114Updated 2 years ago
• AI-secure / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆181Updated 8 months ago
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt injection attacks and defenses in LLMs
  ☆361Updated last month
• eth-sri / sven
  ☆124Updated last year
• AI-secure / Meta-Nerual-Trojan-Detection
  ☆68Updated 5 years ago
• PurduePAML / Machine-Learning-Security-Seminar
  Machine Learning & Security Seminar @Purdue University
  ☆25Updated 2 years ago
• agiresearch / ASB
  Agent Security Bench (ASB)
  ☆155Updated last month
• Testing4AI / DeepJudge
  Code release for DeepJudge (S&P'22)
  ☆52Updated 2 years ago
• safr-ai-lab / survey-llm
  A survey of privacy problems in Large Language Models (LLMs). Contains summary of the corresponding paper along with relevant code
  ☆68Updated last year
• usnistgov / trojai-literature
  ☆150Updated last year
• surrealyz / verified-global-properties
  Learning Security Classifiers with Verified Global Robustness Properties (CCS'21) https://arxiv.org/pdf/2105.11363.pdf
  ☆28Updated 4 years ago