lakeraai / canica

Related projects ⓘ

Alternatives and complementary repositories for canica

• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆87Updated 2 months ago
• microsoft / gandalf_vs_gandalf
  Turning Gandalf against itself. Use LLMs to automate playing Lakera Gandalf challenge without needing to set up an account with a platfor…
  ☆25Updated last year
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆65Updated this week
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆107Updated 8 months ago
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆25Updated 5 months ago
• lakeraai / chrome-extension
  Lakera - ChatGPT Data Leak Protection
  ☆23Updated 4 months ago
• lakeraai / chainguard
  Guard your LangChain applications against prompt injection with Lakera ChainGuard.
  ☆18Updated 7 months ago
• corca-ai / LLMFuzzAgent
  [Corca / ML] Automatically solved Gandalf AI with LLM
  ☆46Updated last year
• OWASP / www-project-machine-learning-security-top-10
  OWASP Machine Learning Security Top 10 Project
  ☆76Updated 2 months ago
• lakeraai / lakera
  ☆44Updated last year
• haizelabs / redteaming-resistance-benchmark
  ☆34Updated 3 months ago
• aiverify-foundation / aiverify
  AI Verify
  ☆123Updated this week
• mitre-atlas / atlas-data
  ATLAS tactics, techniques, and case studies data
  ☆49Updated last month
• subzer0girl2 / AI-Threat-Mind-Map
  ☆20Updated 2 months ago
• Valhall-ai / prompt-injection-mitigations
  A collection of prompt injection mitigation techniques.
  ☆18Updated last year
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆217Updated 6 months ago
• ottosulin / awesome-ai-security
  A collection of awesome resources related AI security
  ☆131Updated 8 months ago
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆347Updated 5 months ago
• andyzorigin / cybench
  ☆63Updated this week
• andyzoujm / breaking-llama-guard
  Code to break Llama Guard
  ☆30Updated 11 months ago
• agencyenterprise / PromptInject
  PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…
  ☆313Updated 8 months ago
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆107Updated 5 months ago
• mitre-atlas / ai-risk-database
  Explore AI Supply Chain Risk with the AI Risk Database
  ☆50Updated 6 months ago
• usnistgov / dioptra
  Test Software for the Characterization of AI Technologies
  ☆226Updated this week
• trailofbits / PrivacyRaven
  Privacy Testing for Deep Learning
  ☆189Updated last year
• llmsecnet / llmsec-site
  source for llmsec.net
  ☆12Updated 3 months ago
• invariantlabs-ai / invariant
  A trace analysis tool for AI agents.
  ☆124Updated last month
• sinanw / llm-security-prompt-injection
  This project investigates the security of large language models by performing binary classification of a set of input prompts to discover…
  ☆34Updated 11 months ago
• trailofbits / awesome-ml-security
  ☆94Updated last month
• sigstore / model-transparency
  Supply chain security for ML
  ☆113Updated this week