ZiyueWang25 / llm-security-challengeLinks
Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the OverTheWire wargames environment, showing the models' surprising ability to do action-oriented cyberexploits in shell environments
☆13Updated 2 years ago
Alternatives and similar repositories for llm-security-challenge
Users that are interested in llm-security-challenge are comparing it to the libraries listed below
Sorting:
- Whispers in the Machine: Confidentiality in Agentic Systems☆41Updated 3 weeks ago
- 🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.☆27Updated last year
- AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks☆56Updated 5 months ago
- LLM security and privacy☆51Updated last year
- Code used to run the platform for the LLM CTF colocated with SaTML 2024☆27Updated last year
- LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins☆28Updated last year
- ☆94Updated 11 months ago
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆359Updated 9 months ago
- Risks and targets for assessing LLMs & LLM vulnerabilities☆32Updated last year
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆97Updated 9 months ago
- [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"☆162Updated 6 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆429Updated last year
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆172Updated 7 months ago
- Code to break Llama Guard☆32Updated last year
- ☆109Updated 6 months ago
- ☆85Updated last year
- The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Lang…☆141Updated 2 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆533Updated last year
- Fine-tuning base models to build robust task-specific models☆34Updated last year
- ☆65Updated 10 months ago
- This repository provides a benchmark for prompt injection attacks and defenses☆318Updated this week
- Implementation for "RigorLLM: Resilient Guardrails for Large Language Models against Undesired Content"☆22Updated last year
- This project explores training data extraction attacks on the LLaMa 7B, GPT-2XL, and GPT-2-IMDB models to discover memorized content usin…☆15Updated 2 years ago
- A collection of prompt injection mitigation techniques.☆24Updated 2 years ago
- Agent Security Bench (ASB)☆141Updated last week
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- TAP: An automated jailbreaking method for black-box LLMs☆194Updated 10 months ago
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆55Updated last year
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆87Updated last year
- ☆52Updated last year