xsankar / AI-Red-Teaming
All things specific to LLM Red Teaming Generative AI
β23Updated 4 months ago
Alternatives and similar repositories for AI-Red-Teaming:
Users that are interested in AI-Red-Teaming are comparing it to the libraries listed below
- π€π‘οΈπππ Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.β23Updated 9 months ago
- The automated prompt injection framework for LLM-integrated applications.β186Updated 6 months ago
- Data Scientists Go To Jupyterβ62Updated last week
- Payloads for Attacking Large Language Modelsβ75Updated 8 months ago
- A collection of prompt injection mitigation techniques.β20Updated last year
- Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.β160Updated last year
- A collection of agents that use Large Language Models (LLMs) to perform tasks common on our day to day jobs in cyber security.β91Updated 10 months ago
- π§ LLMFuzzer - Fuzzing Framework for Large Language Models π§ LLMFuzzer is the first open-source fuzzing framework specifically designed β¦β262Updated last year
- Learn AI security through a series of vulnerable LLM CTF challenges. No sign ups, no cloud fees, run everything locally on your system.β273Updated 6 months ago
- A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.β293Updated 2 months ago
- β37Updated 3 months ago
- This is The most comprehensive prompt hacking course available, which record our progress on a prompt engineering and prompt hacking courβ¦β47Updated last month
- A collection of awesome resources related AI securityβ185Updated last month
- A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)β89Updated 2 months ago
- Cybersecurity Intelligent Pentesting Helper for Ethical Researcher (CIPHER). Fine tuned LLM for penetration testing guidance based on wriβ¦β19Updated 2 months ago
- Dropbox LLM Security research code and resultsβ221Updated 9 months ago
- A benchmark for prompt injection detection systems.β98Updated last month
- A LLM explicitly designed for getting hackedβ139Updated last year
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)β46Updated last month
- CALDERA plugin for adversary emulation of AI-enabled systemsβ93Updated last year
- CTF challenges designed and implemented in machine learning applicationsβ135Updated 6 months ago
- β13Updated 9 months ago
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Benchβ54Updated 2 weeks ago
- β36Updated 2 weeks ago
- LLM | Security | Operations in one github repo with good links and pictures.β24Updated 2 months ago
- Integrate PyRIT in existing toolsβ13Updated last week
- source code for the offsecml frameworkβ38Updated 9 months ago
- OWASP Machine Learning Security Top 10 Projectβ82Updated last month
- A curated list of academic events on AI Security & Privacyβ146Updated 6 months ago
- β28Updated 5 months ago