corca-ai / LLMFuzzAgent
[Corca / ML] Automatically solved Gandalf AI with LLM
☆47Updated last year
Related projects ⓘ
Alternatives and complementary repositories for LLMFuzzAgent
- Red-Teaming Language Models with DSPy☆142Updated 7 months ago
- Fiddler Auditor is a tool to evaluate language models.☆171Updated 8 months ago
- Payloads for Attacking Large Language Models☆64Updated 4 months ago
- Evaluate your LLM apps, RAG pipeline, any generated text, and more!☆0Updated 6 months ago
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆234Updated 9 months ago
- Turning Gandalf against itself. Use LLMs to automate playing Lakera Gandalf challenge without needing to set up an account with a platfor…☆25Updated last year
- Curation of prompts that are known to be adversarial to large language models☆174Updated last year
- A benchmark for prompt injection detection systems.☆87Updated 2 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆313Updated 8 months ago
- Approximation of the Claude 3 tokenizer by inspecting generation stream☆116Updated 4 months ago
- HoneyAgents is a PoC demo of an AI-driven system that combines honeypots with autonomous AI agents to detect and mitigate cyber threats. …☆39Updated 10 months ago
- Uses the ChatGPT model to determine if a user-supplied question is safe and filter out dangerous questions☆43Updated last year
- My inputs for the LLM Gandalf made by Lakera☆36Updated last year
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆162Updated last year
- ☆63Updated this week
- This project investigates the security of large language models by performing binary classification of a set of input prompts to discover…☆34Updated 11 months ago
- A guide to LLM hacking: fundamentals, prompt injection, offense, and defense☆121Updated last year
- Framework for LLM evaluation, guardrails and security☆96Updated 2 months ago
- Make your GenAI Apps Safe & Secure Test & harden your system prompt☆405Updated last month
- Track OpenAI compatible requests to a dataset☆57Updated this week
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆86Updated 5 months ago
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆287Updated last year
- source for llmsec.net☆12Updated 4 months ago
- GPT2 fine-tuning pipeline with KerasNLP, TensorFlow, and TensorFlow Extended☆32Updated last year
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆92Updated last year
- Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.☆114Updated last year
- Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!☆258Updated last month
- Weekly visualization report of Open LLM model performance based on 4 metrics.☆88Updated 11 months ago
- A trace analysis tool for AI agents.☆124Updated last month
- Mixing Language Models with Self-Verification and Meta-Verification☆97Updated last year