Alternatives and similar repositories for whylabs-toolkit:

Users that are interested in whylabs-toolkit are comparing it to the libraries listed below

• whylabs / openllmtelemetry
  Open LLM Telemetry package
  ☆28Updated 4 months ago
• terno-ai / terno-ai
  A team of AI Data Scientists for enterprise structured data.
  ☆25Updated this week
• whylabs / langkit
  🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…
  ☆905Updated 5 months ago
• raga-ai-hub / raga-llm-hub
  Framework for LLM evaluation, guardrails and security
  ☆111Updated 7 months ago
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆387Updated this week
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆179Updated last year
• deepset-ai / rag-with-nvidia-nims
  🚀 Use NVIDIA NIMs with Haystack pipelines
  ☆31Updated 7 months ago
• lakeraai / chrome-extension
  Lakera - ChatGPT Data Leak Protection
  ☆22Updated 9 months ago
• EthicalML / fml-security
  Practical examples of "Flawed Machine Learning Security" together with ML Security best practice across the end to end stages of the mach…
  ☆108Updated 2 years ago
• BCG-X-Official / artkit
  Automated prompt-based testing and evaluation of Gen AI applications
  ☆143Updated last month
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆297Updated 5 months ago
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆30Updated 11 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆277Updated last week
• xvnpw / fabric-agent-action
  🤖 A GitHub action that leverages fabric patterns through an agent-based approach
  ☆25Updated 3 months ago
• precize / OWASP-Agentic-AI
  Top 10 for Agentic AI (AI Agent Security) - Pre-release version
  ☆84Updated last month
• OWASP / www-project-llm-verification-standard
  Project LLM Verification Standard
  ☆43Updated last year
• sinanw / llm-security-prompt-injection
  This project investigates the security of large language models by performing binary classification of a set of input prompts to discover…
  ☆39Updated last year
• confident-ai / deepteam
  The LLM Red Teaming Framework
  ☆49Updated last week
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆417Updated 11 months ago
• langchain-ai / agentevals
  Readymade evaluators for agent trajectories
  ☆169Updated 3 weeks ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆124Updated last week
• compl-ai / compl-ai
  An open-source compliance-centered evaluation framework for Generative AI models
  ☆147Updated 4 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆242Updated 2 months ago
• deepset-ai / hayhooks
  Deploy Haystack pipelines behind a REST Api.
  ☆75Updated this week
• hupe1980 / aisploit
  🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
  ☆23Updated 11 months ago
• aivillage / llm_verification
  LLM prompt attacks for hacker CTFs via CTFd.
  ☆12Updated last year
• lakeraai / lakera
  ☆45Updated 2 years ago
• langfuse / langfuse-python
  🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …
  ☆164Updated this week
• lasso-security / mcp-gateway
  A plugin-based gateway that orchestrates other MCPs and allows developers to build upon it enterprise-grade agents.
  ☆130Updated this week
• genia-dev / vibraniumdome
  LLM Security Platform.
  ☆14Updated 6 months ago