Alternatives and similar repositories for garak

Users that are interested in garak are comparing it to the libraries listed below

• Azure / PyRIT
  The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and eng…
  ☆2,838Updated this week
• protectai / llm-guard
  The Security Toolkit for LLM Interactions
  ☆2,010Updated this week
• OWASP / www-project-top-10-for-large-language-model-applications
  OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)
  ☆869Updated last week
• protectai / vulnhuntr
  Zero shot vulnerability discovery using LLMs
  ☆2,254Updated 6 months ago
• protectai / rebuff
  LLM Prompt Injection Detector
  ☆1,341Updated last year
• meta-llama / PurpleLlama
  Set of tools to assess and improve LLM security.
  ☆3,709Updated this week
• prompt-security / ps-fuzz
  Make your GenAI Apps Safe & Secure Test & harden your system prompt
  ☆552Updated last month
• corca-ai / awesome-llm-security
  A curation of awesome tools, documents and projects about LLM Security.
  ☆1,363Updated last week
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆5,023Updated this week
• protectai / modelscan
  Protection against Model Serialization Attacks
  ☆553Updated 2 weeks ago
• utkusen / promptmap
  a security scanner for custom LLM applications
  ☆939Updated last week
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆5,538Updated last month
• Giskard-AI / giskard-oss
  🐢 Open-Source Evaluation & Testing library for LLM Agents
  ☆4,835Updated this week
• llm-attacks / llm-attacks
  Universal and Transferable Attacks on Aligned Language Models
  ☆4,169Updated last year
• aliasrobotics / cai
  Cybersecurity AI (CAI), the framework for AI Security
  ☆3,336Updated this week
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…
  ☆8,184Updated this week
• microsoft / AI-Red-Teaming-Playground-Labs
  AI Red Teaming playground labs to run AI Red Teaming trainings including infrastructure.
  ☆1,520Updated 2 weeks ago
• jthack / PIPE
  Prompt Injection Primer for Engineers
  ☆460Updated 2 years ago
• projectdiscovery / cvemap
  Modern CLI for exploring vulnerability data with powerful search, filtering, and analysis capabilities.
  ☆2,085Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,388Updated 5 months ago
• verazuo / jailbreak_llms
  [CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak…
  ☆3,323Updated 8 months ago
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆10,472Updated this week
• google / oss-fuzz-gen
  LLM powered fuzzing via OSS-Fuzz.
  ☆1,271Updated 2 weeks ago
• cckuailong / awesome-gpt-security
  A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.
  ☆622Updated 3 weeks ago
• AgentOps-AI / tokencost
  Easy token price estimates for 400+ LLMs. TokenOps.
  ☆1,784Updated this week
• jiep / offensive-ai-compilation
  A curated list of useful resources that cover Offensive AI.
  ☆1,271Updated last week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,397Updated 3 months ago
• RiccardoBiosas / awesome-MLSecOps
  A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
  ☆361Updated last month
• protectai / ai-exploits
  A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities
  ☆1,654Updated 10 months ago
• mbrg / power-pwn
  An offensive security toolset for Microsoft 365 focused on Microsoft Copilot, Copilot Studio and Power Platform
  ☆1,045Updated last week