aiverify-foundation / aiverify

Related projects ⓘ

Alternatives and complementary repositories for aiverify

• aiverify-foundation / moonshot
  Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
  ☆180Updated this week
• Giskard-AI / awesome-ai-safety
  📚 A curated list of papers & technical articles on AI Quality & Safety
  ☆161Updated last year
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆171Updated 8 months ago
• haizelabs / redteaming-resistance-benchmark
  ☆34Updated 3 months ago
• aiverify-foundation / moonshot-data
  Contains all assets to run with Moonshot Library (Connectors, Datasets and Metrics)
  ☆18Updated this week
• stanford-crfm / EUAIActJune15
  Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
  ☆92Updated last year
• invariantlabs-ai / invariant
  A trace analysis tool for AI agents.
  ☆124Updated last month
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆107Updated 8 months ago
• AI-secure / DecodingTrust
  A Comprehensive Assessment of Trustworthiness in GPT Models
  ☆261Updated 2 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆84Updated 8 months ago
• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆62Updated this week
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆106Updated this week
• UKGovernmentBEIS / inspect_ai
  Inspect: A framework for large language model evaluations
  ☆624Updated this week
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆65Updated this week
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆221Updated last week
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆222Updated last month
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆142Updated 7 months ago
• aiverify-foundation / LLM-Evals-Catalogue
  This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation fr…
  ☆14Updated last year
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆392Updated 6 months ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆41Updated last month
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆87Updated 2 months ago
• HumanCompatibleAI / tensor-trust-data
  Dataset for the Tensor Trust project
  ☆33Updated 8 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆114Updated last week
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆220Updated 2 months ago
• agencyenterprise / PromptInject
  PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…
  ☆313Updated 8 months ago
• lakeraai / chrome-extension
  Lakera - ChatGPT Data Leak Protection
  ☆23Updated 4 months ago
• lakeraai / canica
  A text embedding viewer for the Jupyter environment
  ☆18Updated 9 months ago
• Libr-AI / do-not-answer
  Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs
  ☆184Updated 5 months ago
• prompt-security / ps-fuzz
  Make your GenAI Apps Safe & Secure Test & harden your system prompt
  ☆404Updated last month
• centerforaisafety / Intro_to_ML_Safety
  ☆65Updated last year