Repello-AI / whistleblowerLinks
Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and folks who want to know what's going on inside the LLM-based app they use daily
☆149Updated 3 months ago
Alternatives and similar repositories for whistleblower
Users that are interested in whistleblower are comparing it to the libraries listed below
Sorting:
- A CLI tool for threat modeling and visualizing AI agents built using popular frameworks like LangGraph, AutoGen, CrewAI, and more.☆364Updated 3 months ago
- A guide to LLM hacking: fundamentals, prompt injection, offense, and defense☆182Updated 2 years ago
- AgentFence is an open-source platform for automatically testing AI agent security. It identifies vulnerabilities such as prompt injection…☆50Updated 11 months ago
- CTF challenges designed and implemented in machine learning applications☆201Updated 4 months ago
- Payloads for Attacking Large Language Models☆119Updated 3 weeks ago
- LLM | Security | Operations in one github repo with good links and pictures.☆88Updated this week
- LMAP (large language model mapper) is like NMAP for LLM, is an LLM Vulnerability Scanner and Zero-day Vulnerability Fuzzer.☆28Updated last year
- A collection of awesome resources related AI security☆533Updated this week
- ☆156Updated 5 months ago
- A curated list of awesome LLM Red Teaming training, resources, and tools.☆75Updated 5 months ago
- Security Rules & Workflows for the new wave of AI Development.☆45Updated 6 months ago
- 🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.☆28Updated last year
- Code for the paper "Defeating Prompt Injections by Design"☆246Updated 7 months ago
- Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.☆166Updated 2 years ago
- Jeopardy-style CTF challenge deployment and management tool.☆79Updated this week
- 🤖 A GitHub action that leverages fabric patterns through an agent-based approach☆34Updated last year
- Lightweight LLM Interaction Framework☆406Updated last week
- The fastest Trust Layer for AI Agents☆152Updated last week
- Learn about a type of vulnerability that specifically targets machine learning models☆405Updated 4 months ago
- Writeups of challenges and CTFs I participated in☆86Updated 5 months ago
- Welcome to the ultimate list of resources for AI in cybersecurity. This repository aims to provide an organized collection of high-qualit…☆100Updated 2 months ago
- A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.☆421Updated 6 months ago
- A LLM explicitly designed for getting hacked☆166Updated 2 years ago
- Learn AI security through a series of vulnerable LLM CTF challenges. No sign ups, no cloud fees, run everything locally on your system.☆314Updated last year
- OWASP Machine Learning Security Top 10 Project☆95Updated last month
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆100Updated 9 months ago
- A collection of prompt injection mitigation techniques.☆27Updated 2 years ago
- An Open Source CTF hosting platform☆62Updated 11 months ago
- Dropbox LLM Security research code and results☆254Updated last year
- A library for red-teaming LLM applications with LLMs.☆29Updated last year