Alternatives and similar repositories for chatgpt-plugin-eval

Users that are interested in chatgpt-plugin-eval are comparing it to the libraries listed below

• BHui97 / PLeak
  ☆64Updated 9 months ago
• facebookresearch / SecAlign
  Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"
  ☆71Updated 2 months ago
• iliaishacked / sponge_examples
  ☆25Updated 4 years ago
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt injection attacks and defenses
  ☆301Updated this week
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆94Updated 8 months ago
• eth-sri / sven
  ☆122Updated last year
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆318Updated this week
• PurduePAML / Machine-Learning-Security-Seminar
  Machine Learning & Security Seminar @Purdue University
  ☆25Updated 2 years ago
• Sizhe-Chen / StruQ
  official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries
  ☆46Updated 2 months ago
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆55Updated last year
• datasec-lab / CodeBreaker
  [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…
  ☆52Updated 6 months ago
• microsoft / analysing_pii_leakage
  The repository contains the code for analysing the leakage of personally identifiable (PII) information from the output of next word pred…
  ☆101Updated last year
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆74Updated last year
• ThuCCSLab / JailbreakEval
  [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆171Updated 6 months ago
• uiuc-kang-lab / InjecAgent
  ☆81Updated last year
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆91Updated last year
• wagner-group / prompt-injection-defense
  Fine-tuning base models to build robust task-specific models
  ☆34Updated last year
• microsoft / TaskTracker
  TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…
  ☆68Updated last month
• ZhengyuZhao / AI-Security-and-Privacy-Events
  A curated list of academic events on AI Security & Privacy
  ☆162Updated last year
• AI-secure / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆158Updated 6 months ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆51Updated last year
• SolidShen / BAIT
  🔥🔥🔥 Detecting hidden backdoors in Large Language Models with only black-box access
  ☆45Updated 4 months ago
• RICommunity / TAP
  TAP: An automated jailbreaking method for black-box LLMs
  ☆188Updated 10 months ago
• usail-hkust / JailTrickBench
  Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)
  ☆151Updated 10 months ago
• chawins / llm-sp
  Papers and resources related to the security and privacy of LLMs 🤖
  ☆536Updated 4 months ago
• s2e-lab / SecurityEval
  Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…
  ☆80Updated last year
• ethz-spylab / satml-llm-ctf
  Code used to run the platform for the LLM CTF colocated with SaTML 2024
  ☆27Updated last year
• LostOxygen / llm-confidentiality
  Whispers in the Machine: Confidentiality in Agentic Systems
  ☆41Updated last week
• ZhangZhuoSJTU / LINT
  ☆16Updated last year
• AI-secure / Meta-Nerual-Trojan-Detection
  ☆66Updated 5 years ago