Detection of malicious prompts used to exploit large language models (LLMs) by leveraging supervised machine learning classifiers.
☆21Oct 30, 2024Updated 2 years ago
Alternatives and similar repositories for malicious-prompt-detection
Users that are interested in malicious-prompt-detection are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 2024 Berkeley AI Hackathon Repo☆13Jun 27, 2024Updated 2 years ago
- Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique☆19Aug 22, 2024Updated 2 years ago
- ToxicSkills - malicious agent skills in openclaw / clawhub / agent supply chain☆19Jun 28, 2026Updated 4 months ago
- ☆23Jul 26, 2025Updated last year
- Detecting gibberish as a type of sentiment analysis with GPT2☆25Nov 10, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- AIxCC: automated vulnerability repair via LLMs, search, and static analysis☆13Jul 16, 2024Updated 2 years ago
- Official Implementation for Quality-Similar Diversity via Population Based Reinforcement Learning☆18Dec 26, 2025Updated 10 months ago
- Unleashing Worms and Extracting Data: Escalating the Outcome of Attacks against RAG-based Inference in Scale and Severity Using Jailbreak…☆11Sep 15, 2024Updated 2 years ago
- Public results and products from DARPA AIxCC☆12Aug 11, 2025Updated last year
- A minimal implementation of Go-Explore without domain knowledge☆15Apr 26, 2021Updated 5 years ago
- Official Repository of the Entity-based Reinforcement Learning for Autonomous Cyber Defence paper.☆19Jan 24, 2025Updated last year
- Web app that can be trained to detect Github users based on coding style☆22Dec 17, 2014Updated 11 years ago
- Vstream - Video Analytics pipeline with Hardware based accelerations (dev - stage)☆10Feb 2, 2024Updated 2 years ago
- jsonpointer for golang with support for structs☆53Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Official Repository for Can Language Models be Instructed to Protect Personal Information?☆14Oct 8, 2023Updated 3 years ago
- Postman for your MCP server with a Claude chat that calls your tools☆14Jun 3, 2025Updated last year
- PoC of Spring AMQP Deserialization Vulnerability (CVE-2023-34050)☆13Jan 29, 2024Updated 2 years ago
- A python module for reliq library☆14May 16, 2026Updated 6 months ago
- The code implementation of GraCeFul (Accepted in COLING 2025)☆14Jan 27, 2025Updated last year
- Qwen Code companion for Claude Code — delegate rescues, investigations, and code reviews to the qwen CLI from inside your Claude Code ses…☆11Apr 15, 2026Updated 7 months ago
- GLM-5.2 744B with a true 4-bit NVFP4 KV cache on 4x DGX Spark: 42 tok/s peak, 317K-token KV pool (+58.6% vs fp8), needle-verified at 250K…☆15Jul 21, 2026Updated 3 months ago
- [ACL 2025] The official implementation of the paper "PIGuard: Prompt Injection Guardrail via Mitigating Overdefense for Free".☆90Dec 4, 2025Updated 11 months ago
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆511Jan 31, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Keras-based recommendation engine for subreddits, channels on the popular social media site Reddit☆11Feb 24, 2024Updated 2 years ago
- COBOL Modernization Pipeline☆14Nov 8, 2025Updated last year
- Risks and targets for assessing LLMs & LLM vulnerabilities☆36May 27, 2024Updated 2 years ago
- Chinese(zh) sentence NSW(Non-Standard-Word) Normalization☆12Apr 10, 2025Updated last year
- Generative AI-based CyberSecurity-focused Prompt Dataset for Benchmarking Large Language Models☆51Jan 14, 2025Updated last year
- OPFOR Scripting Engine☆14Sep 4, 2026Updated 2 months ago
- Panda - is a set of utilities used to research how PsExec encrypts its traffic.☆14Apr 20, 2021Updated 5 years ago
- Security scanner for MCP servers. Every finding carries its evidence, including the server's actual response bytes.☆12Sep 4, 2026Updated 2 months ago
- Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"☆59Sep 20, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Cancel any running operation at the right time on your request handler☆16Nov 1, 2026Updated 2 weeks ago
- Python-based cloud node for local use☆11Mar 7, 2018Updated 8 years ago
- ☆50Dec 9, 2025Updated 11 months ago
- Detection of malicious domain names using machine learning and deep learning models☆16Nov 6, 2018Updated 8 years ago
- Support UEFI load☆11Oct 1, 2015Updated 11 years ago
- A Lua extension library that allows to run various scripting languages from within Lua scripts, cross-language require scripts and load 3…☆19Nov 23, 2020Updated 5 years ago
- ☆10Oct 7, 2026Updated last month
Are these results useful?