Alternatives and similar repositories for garak

Users that are interested in garak are comparing it to the libraries listed below

• Azure / PyRIT
  The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and eng…
  ☆2,901Updated this week
• protectai / llm-guard
  The Security Toolkit for LLM Interactions
  ☆2,074Updated this week
• protectai / vulnhuntr
  Zero shot vulnerability discovery using LLMs
  ☆2,291Updated 7 months ago
• OWASP / www-project-top-10-for-large-language-model-applications
  OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)
  ☆898Updated this week
• protectai / rebuff
  LLM Prompt Injection Detector
  ☆1,352Updated last year
• greshake / llm-security
  New ways of breaking app-integrated LLMs
  ☆1,992Updated 2 months ago
• protectai / modelscan
  Protection against Model Serialization Attacks
  ☆571Updated this week
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆5,074Updated this week
• prompt-security / ps-fuzz
  Make your GenAI Apps Safe & Secure Test & harden your system prompt
  ☆563Updated last month
• msoedov / agentic_security
  Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪
  ☆1,673Updated this week
• meta-llama / PurpleLlama
  Set of tools to assess and improve LLM security.
  ☆3,762Updated last week
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆5,647Updated last week
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆546Updated 6 months ago
• aliasrobotics / cai
  Cybersecurity AI (CAI), the framework for AI Security
  ☆3,961Updated this week
• corca-ai / awesome-llm-security
  A curation of awesome tools, documents and projects about LLM Security.
  ☆1,392Updated last month
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…
  ☆8,397Updated this week
• ipa-lab / hackingBuddyGPT
  Helping Ethical Hackers use LLMs in 50 Lines of Code or less..
  ☆810Updated 2 weeks ago
• protectai / ai-exploits
  A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities
  ☆1,659Updated 10 months ago
• Giskard-AI / giskard-oss
  🐢 Open-Source Evaluation & Testing library for LLM Agents
  ☆4,878Updated last week
• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆315Updated last year
• deadbits / vigil-llm
  ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
  ☆414Updated last year
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,780Updated last month
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆10,885Updated this week
• llm-attacks / llm-attacks
  Universal and Transferable Attacks on Aligned Language Models
  ☆4,209Updated last year
• Lightning-AI / LitServe
  The easiest way to deploy agents, MCP servers, models, RAG, pipelines and more. No MLOps. No YAML.
  ☆3,563Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,423Updated 6 months ago
• UKGovernmentBEIS / inspect_ai
  Inspect: A framework for large language model evaluations
  ☆1,323Updated this week
• projectdiscovery / cvemap
  Modern CLI for exploring vulnerability data with powerful search, filtering, and analysis capabilities.
  ☆2,099Updated last week
• Arize-ai / phoenix
  AI Observability & Evaluation
  ☆7,021Updated this week
• evilsocket / nerve
  The Simple Agent Development Kit.
  ☆1,168Updated 3 weeks ago