lakeraai / canica

Related projects: ⓘ

• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆80Updated last week
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆103Updated 6 months ago
• microsoft / gandalf_vs_gandalf
  Turning Gandalf against itself. Use LLMs to automate playing Lakera Gandalf challenge without needing to set up an account with a platfor…
  ☆24Updated 11 months ago
• corca-ai / LLMFuzzAgent
  [Corca / ML] Automatically solved Gandalf AI with LLM
  ☆46Updated last year
• lakeraai / chrome-extension
  Lakera - ChatGPT Data Leak Protection
  ☆23Updated 2 months ago
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆210Updated 3 months ago
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆24Updated 3 months ago
• agencyenterprise / PromptInject
  PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…
  ☆293Updated 6 months ago
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆310Updated 3 months ago
• protectai / nbdefense
  Secure Jupyter Notebooks and Experimentation Environment
  ☆52Updated last month
• OWASP / www-project-machine-learning-security-top-10
  OWASP Machine Learning Security Top 10 Project
  ☆69Updated last week
• lakeraai / chainguard
  Guard your LangChain applications against prompt injection with Lakera ChainGuard.
  ☆16Updated 5 months ago
• timothee-chauvin / eyeballvul
  future-proof vulnerability detection benchmark, based on CVEs in open-source repos
  ☆41Updated last week
• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆218Updated 7 months ago
• mitre-atlas / atlas-data
  ATLAS tactics, techniques, and case studies data
  ☆46Updated 2 months ago
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆181Updated last month
• protectai / modelscan
  Protection against Model Serialization Attacks
  ☆273Updated this week
• OWASP / www-project-llm-verification-standard
  Project LLM Verification Standard
  ☆32Updated 5 months ago
• sigstore / model-transparency
  Supply chain security for ML
  ☆105Updated last week
• ottosulin / awesome-ai-security
  A collection of awesome resources related AI security
  ☆107Updated 5 months ago
• usnistgov / dioptra
  Test Software for the Characterization of AI Technologies
  ☆212Updated last week
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆48Updated last week
• sinanw / llm-security-prompt-injection
  This project investigates the security of large language models by performing binary classification of a set of input prompts to discover…
  ☆30Updated 9 months ago
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆100Updated 3 months ago
• mik0w / pallms
  Payloads for Attacking Large Language Models
  ☆56Updated 2 months ago
• lakeraai / lakera
  ☆43Updated last year
• haizelabs / redteaming-resistance-benchmark
  ☆31Updated last month
• OWASP / www-project-ai-security-and-privacy-guide
  OWASP Foundation Web Respository
  ☆199Updated last month
• RiccardoBiosas / awesome-MLSecOps
  A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
  ☆220Updated last month
• trailofbits / awesome-ml-security
  ☆89Updated last month