aiverify-foundation / aiverify

Related projects ⓘ

Alternatives and complementary repositories for aiverify

• aiverify-foundation / moonshot
  Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
  ☆174Updated this week
• aiverify-foundation / moonshot-data
  Contains all assets to run with Moonshot Library (Connectors, Datasets and Metrics)
  ☆18Updated this week
• usnistgov / dioptra
  Test Software for the Characterization of AI Technologies
  ☆225Updated this week
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆171Updated 7 months ago
• haizelabs / redteaming-resistance-benchmark
  ☆33Updated 3 months ago
• invariantlabs-ai / invariant
  A trace analysis tool for AI agents.
  ☆118Updated 3 weeks ago
• Giskard-AI / awesome-ai-safety
  📚 A curated list of papers & technical articles on AI Quality & Safety
  ☆160Updated last year
• AI-secure / DecodingTrust
  A Comprehensive Assessment of Trustworthiness in GPT Models
  ☆260Updated last month
• credo-ai / credoai_lens
  Credo AI Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central …
  ☆46Updated 4 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆106Updated 7 months ago
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆467Updated 4 months ago
• deadbits / vigil-llm
  ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
  ☆308Updated 9 months ago
• stanford-crfm / EUAIActJune15
  Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
  ☆92Updated last year
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆84Updated 8 months ago
• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆60Updated this week
• agencyenterprise / PromptInject
  PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…
  ☆306Updated 8 months ago
• centerforaisafety / HarmBench
  HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal
  ☆322Updated 2 months ago
• holistic-ai / holisticai
  This is an open-source tool to assess and improve the trustworthiness of AI systems.
  ☆78Updated this week
• UKGovernmentBEIS / inspect_ai
  Inspect: A framework for large language model evaluations
  ☆606Updated this week
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆211Updated last month
• stanford-crfm / fmti
  The Foundation Model Transparency Index
  ☆70Updated 5 months ago
• Libr-AI / do-not-answer
  Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs
  ☆180Updated 5 months ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆389Updated 6 months ago
• poloclub / llm-self-defense
  LLM Self Defense: By Self Examination, LLMs know they are being tricked
  ☆26Updated 5 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆142Updated 7 months ago
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆86Updated 2 months ago
• prompt-security / ps-fuzz
  Make your GenAI Apps Safe & Secure Test & harden your system prompt
  ☆398Updated 3 weeks ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆38Updated 3 weeks ago
• OWASP / www-project-top-10-for-large-language-model-applications
  OWASP Foundation Web Respository
  ☆567Updated this week
• dylan-slack / TalkToModel
  TalkToModel gives anyone with the powers of XAI through natural language conversations 💬!
  ☆110Updated last year