Repo for the paper "Meta SecAlign: A Secure Foundation LLM Against Prompt Injection Attacks".
☆70Jun 11, 2026Updated last month
Alternatives and similar repositories for Meta_SecAlign
Users that are interested in Meta_SecAlign are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆99Jul 2, 2026Updated last month
- [EMNLP 2025 Oral] IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents☆22Sep 16, 2025Updated 10 months ago
- official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries☆77Nov 10, 2025Updated 9 months ago
- ☆15Nov 29, 2025Updated 8 months ago
- [ACL 2026] PIArena: A Platform for Prompt Injection Evaluation☆44Apr 28, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- PISanitizer: Preventing Prompt Injection to Long-Context LLMs via Prompt Sanitization☆18Dec 10, 2025Updated 8 months ago
- [NeurIPS 2025] The official implementation of the paper "DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agen…☆59Jul 16, 2026Updated 3 weeks ago
- ☆157Jul 2, 2024Updated 2 years ago
- Official release of code for the paper RL is a hammer and LLMs are nails A simple RL approach to stronger prompt injection attacks☆53May 6, 2026Updated 3 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆731Jun 2, 2026Updated 2 months ago
- A research workbench for developing and testing attacks against large language models, with a focus on prompt injection vulnerabilities a…☆59Jul 24, 2026Updated 2 weeks ago
- The official implementation of the paper "AgentDyn: Are Your Agent Security Defenses Deployable in Real-World Dynamic Environments?"☆72May 19, 2026Updated 2 months ago
- Repo for the paper "Defending Against Prompt Injection With a Few DefensiveTokens"☆19Nov 10, 2025Updated 9 months ago
- [ICML 2026] Official implementation for paper "Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Ag…☆31Jul 31, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Progent: Securing AI Agents with Privilege Control☆46May 14, 2026Updated 2 months ago
- This repository provides a benchmark for prompt injection attacks and defenses in LLMs☆473Oct 29, 2025Updated 9 months ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆93Sep 1, 2025Updated 11 months ago
- PISmith: Reinforcement Learning-based Red Teaming for Prompt Injection Defenses☆22Jul 17, 2026Updated 3 weeks ago
- ☆21Jun 12, 2026Updated last month
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆116Sep 27, 2024Updated last year
- Code repository for the paper --- [USENIX Security 2023] Towards A Proactive ML Approach for Detecting Backdoor Poison Samples☆31Jul 11, 2023Updated 3 years ago
- Code and full version of the paper "Hijacking Attacks against Neural Network by Analyzing Training Data"☆15Feb 28, 2024Updated 2 years ago
- Official Implementation of "ToolSafe: Enhancing Tool Invocation Safety of LLM-based Agents via Proactive Step-level Guardrail and Feedbac…☆74Mar 25, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [ACL 2025] The official code for "AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection".☆43Aug 4, 2025Updated last year
- Code and data for our paper "Are You Copying My Model? Protecting the Copyright of Large Language Models for EaaS via Backdoor Watermark"…☆52Jul 11, 2023Updated 3 years ago
- [ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.☆90Jan 19, 2025Updated last year
- Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873☆183May 6, 2024Updated 2 years ago
- Implementation for paper Automata Extraction from Transformers.☆12Jun 8, 2024Updated 2 years ago
- ☆15Jun 6, 2023Updated 3 years ago
- An Embarrassingly Simple Backdoor Attack on Self-supervised Learning☆22Jan 24, 2024Updated 2 years ago
- Agent Security Bench (ASB)☆277Apr 16, 2026Updated 3 months ago
- ☆39Mar 12, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Automatic Jailbreaking of the Text-to-Image Generative AI Systems☆15Jun 23, 2024Updated 2 years ago
- ☆23May 14, 2025Updated last year
- An attempt to migrate Karpathy's llm.c to safe rust.☆13Jun 4, 2024Updated 2 years ago
- ☆33Feb 27, 2025Updated last year
- [CCS 2026] The official implementation of our CCS 2026 paper "ReasoningBomb: A Stealthy Denial-of-Service Attack by Inducing Pathological…☆16Updated this week
- ☆22Dec 14, 2023Updated 2 years ago
- [ICLR 2026 Oral] Invisible Safety Threat: Malicious Finetuning for LLM via Steganography☆20Mar 22, 2026Updated 4 months ago