Alternatives and similar repositories for satml-llm-ctf

Users that are interested in satml-llm-ctf are comparing it to the libraries listed below

• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆112Updated last year
• tuhh-softsec / LLMSecEval
  ☆54Updated last year
• llm-platform-security / chatgpt-plugin-eval
  LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins
  ☆29Updated last year
• aixcc-public / challenge-001-exemplar
  Challenge Problem #1 - Linux Kernel (NOTE: This code does not reflect the active state of what will be used at competition time, please r…
  ☆59Updated last year
• sunblaze-ucb / cybergym
  CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…
  ☆98Updated 2 months ago
• rabbitjy / FuzzTuning
  ☆25Updated 2 years ago
• PSUCyberSecurityLab / AIforCybersecurity
  Code for Book "AI for Cybersecurity: A Handbook of Use Case"
  ☆21Updated 2 years ago
• NickNameInvalid / LLM_CTF
  ☆65Updated 2 months ago
• SolidShen / BAIT
  🔥🔥🔥 Detecting hidden backdoors in Large Language Models with only black-box access
  ☆50Updated 6 months ago
• s2e-lab / SecurityEval
  Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…
  ☆82Updated 2 years ago
• andyzorigin / cybench
  ☆178Updated 5 months ago
• eth-sri / sven
  ☆124Updated last year
• PurCL / ASTRA
  🥇 Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeati…
  ☆63Updated 3 months ago
• microsoft / BIPIA
  A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
  ☆90Updated last year
• IBM / URET
  Universal Robustness Evaluation Toolkit (for Evasion)
  ☆32Updated 2 months ago
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆55Updated last year
• ZhangZhuoSJTU / LINT
  ☆17Updated last year
• timothee-chauvin / eyeballvul
  future-proof vulnerability detection benchmark, based on CVEs in open-source repos
  ☆63Updated this week
• NYU-LLM-CTF / nyuctf_agents
  The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench
  ☆109Updated last month
• aseec-lab / llms-for-code-analysis
  ☆34Updated last year
• trailofbits / awesome-ml-security
  ☆151Updated 3 months ago
• andyzoujm / breaking-llama-guard
  Code to break Llama Guard
  ☆32Updated 2 years ago
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆115Updated last year
• surrealyz / verified-global-properties
  Learning Security Classifiers with Verified Global Robustness Properties (CCS'21) https://arxiv.org/pdf/2105.11363.pdf
  ☆28Updated 4 years ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆52Updated last year
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆100Updated 10 months ago
• compsec-snu / pfi
  PFI: Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agents
  ☆26Updated 8 months ago
• niklasrisse / LimitsOfML4Vuln
  ☆25Updated last year
• LostOxygen / llm-confidentiality
  Whispers in the Machine: Confidentiality in Agentic Systems
  ☆41Updated last week
• datasec-lab / CodeBreaker
  [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…
  ☆53Updated 8 months ago