microsoft / TaskTracker

Related projects ⓘ

Alternatives and complementary repositories for TaskTracker

• microsoft / BIPIA
  A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
  ☆47Updated 7 months ago
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆64Updated 9 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆44Updated 5 months ago
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆65Updated this week
• facebookresearch / SecAlign
  Repo for the research paper "Aligning LLMs to Be Robust Against Prompt Injection"
  ☆19Updated 3 weeks ago
• arobey1 / smooth-llm
  ☆81Updated last year
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆115Updated 8 months ago
• allenai / wildguard
  Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
  ☆39Updated 3 weeks ago
• xinleihe / toxic-prompt
  ☆19Updated last year
• iamgroot42 / mimir
  Python package for measuring memorization in LLMs.
  ☆122Updated 2 months ago
• HumanCompatibleAI / tensor-trust-data
  Dataset for the Tensor Trust project
  ☆33Updated 8 months ago
• bboylyg / BackdoorLLM
  BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks on Large Language Models
  ☆74Updated 2 months ago
• SolidShen / RIPPLE_official
  ☆20Updated 9 months ago
• AlexWan0 / Poisoning-Instruction-Tuned-Models
  ☆50Updated 5 months ago
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆99Updated 4 months ago
• BillChan226 / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆59Updated 3 months ago
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆52Updated last month
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆46Updated 3 months ago
• azshue / AutoPoison
  The official repository of the paper "On the Exploitability of Instruction Tuning".
  ☆57Updated 9 months ago
• Confirm-Solutions / flrt
  Fluent student-teacher redteaming
  ☆14Updated 3 months ago
• max-andr / adversarial-random-search-gpt4
  Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]
  ☆42Updated 6 months ago
• thestephencasper / explore_establish_exploit_llms
  ☆31Updated last year
• microsoft / dp-few-shot-generation
  ☆22Updated 11 months ago
• leix28 / prompt-universal-vulnerability
  Implementation of the paper "Exploring the Universal Vulnerability of Prompt-based Learning Paradigm" on Findings of NAACL 2022
  ☆27Updated 2 years ago
• BHui97 / PLeak
  ☆39Updated 9 months ago
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆220Updated 2 months ago
• collinzrj / output2prompt
  ☆36Updated 3 weeks ago
• Vaidehi99 / InfoDeletionAttacks
  ☆38Updated last year
• poloclub / llm-self-defense
  LLM Self Defense: By Self Examination, LLMs know they are being tricked
  ☆27Updated 6 months ago
• verazuo / prompt-stealing-attack
  [USENIX'24] Prompt Stealing Attacks Against Text-to-Image Generation Models
  ☆24Updated last month