Alternatives and similar repositories for chatgpt-plugin-eval

Users that are interested in chatgpt-plugin-eval are comparing it to the libraries listed below

• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆97Updated 9 months ago
• BHui97 / PLeak
  ☆67Updated 10 months ago
• iliaishacked / sponge_examples
  ☆25Updated 4 years ago
• facebookresearch / SecAlign
  Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"
  ☆74Updated 3 months ago
• Sizhe-Chen / StruQ
  official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries
  ☆50Updated 3 months ago
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆55Updated last year
• s2e-lab / SecurityEval
  Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…
  ☆80Updated 2 years ago
• eth-sri / sven
  ☆123Updated last year
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt injection attacks and defenses
  ☆330Updated last week
• PurduePAML / Machine-Learning-Security-Seminar
  Machine Learning & Security Seminar @Purdue University
  ☆25Updated 2 years ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆51Updated last year
• niuliang42 / CodexLeaks
  CodexLeaks: Privacy Leaks from Code Generation Language Models in GitHub Copilot
  ☆11Updated 2 years ago
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆96Updated last year
• SolidShen / BAIT
  🔥🔥🔥 Detecting hidden backdoors in Large Language Models with only black-box access
  ☆45Updated 5 months ago
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆75Updated last year
• datasec-lab / CodeBreaker
  [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…
  ☆51Updated 7 months ago
• surrealyz / verified-global-properties
  Learning Security Classifiers with Verified Global Robustness Properties (CCS'21) https://arxiv.org/pdf/2105.11363.pdf
  ☆28Updated 3 years ago
• microsoft / TaskTracker
  TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…
  ☆74Updated 2 months ago
• uiuc-kang-lab / InjecAgent
  ☆89Updated last year
• AI-secure / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆163Updated 6 months ago
• ethz-spylab / satml-llm-ctf
  Code used to run the platform for the LLM CTF colocated with SaTML 2024
  ☆27Updated last year
• tuhh-softsec / LLMSecEval
  ☆52Updated last year
• usail-hkust / JailTrickBench
  Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)
  ☆153Updated 11 months ago
• LostOxygen / llm-confidentiality
  Whispers in the Machine: Confidentiality in Agentic Systems
  ☆41Updated this week
• arobey1 / smooth-llm
  ☆111Updated last year
• reddy-lab-code-research / CodeAttack
  Code for the AAAI 2023 paper "CodeAttack: Code-based Adversarial Attacks for Pre-Trained Programming Language Models
  ☆33Updated 2 years ago
• microsoft / analysing_pii_leakage
  The repository contains the code for analysing the leakage of personally identifiable (PII) information from the output of next word pred…
  ☆101Updated last year
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆340Updated last week
• ZhangZhuoSJTU / LINT
  ☆17Updated last year
• RICommunity / TAP
  TAP: An automated jailbreaking method for black-box LLMs
  ☆194Updated 10 months ago