Alternatives and similar repositories for whylabs-toolkit

Users that are interested in whylabs-toolkit are comparing it to the libraries listed below

• whylabs / openllmtelemetry
  Open LLM Telemetry package
  ☆28Updated 6 months ago
• whylabs / whylabs-oss
  Source code of the WhyLabs Platform OSS
  ☆12Updated 4 months ago
• whylabs / langkit
  🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…
  ☆913Updated 6 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆181Updated last year
• whylabs / whylogs
  An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model perf…
  ☆2,723Updated 4 months ago
• whylabs / whylogs-java
  Profile and monitor your ML data pipeline end-to-end
  ☆178Updated 3 years ago
• deadbits / vector-embedding-api
  Flask API for generating text embeddings using OpenAI or sentence_transformers
  ☆14Updated last year
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆31Updated last year
• usagepanda / proxy
  Security and compliance proxy for LLM APIs
  ☆47Updated last year
• lakeraai / chrome-extension
  Lakera - ChatGPT Data Leak Protection
  ☆22Updated 11 months ago
• aryakvnust / LLMSecGuard
  LLM Security Guard for Code
  ☆18Updated 9 months ago
• invariantlabs-ai / invariant-gateway
  LLM proxy to observe and debug what your AI agents are doing.
  ☆33Updated this week
• Giskard-AI / giskard-vision
  📸 Open-Source Evaluation & Testing for Computer Vision AI systems
  ☆28Updated 7 months ago
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆446Updated this week
• lakeraai / chainguard
  Guard your LangChain applications against prompt injection with Lakera ChainGuard.
  ☆22Updated 3 months ago
• AlmogBaku / pytest-evals
  A pytest plugin for running and analyzing LLM evaluation tests.
  ☆123Updated 4 months ago
• EthicalML / fml-security
  Practical examples of "Flawed Machine Learning Security" together with ML Security best practice across the end to end stages of the mach…
  ☆110Updated 3 years ago
• ZiyueWang25 / llm-security-challenge
  Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…
  ☆13Updated last year
• cyberark / agentwatch
  A powerful AI observability framework that provides comprehensive insights into agent interactions across platforms, enabling developers …
  ☆82Updated 3 weeks ago
• ajac-zero / excel-rag-example
  An example notebook to build RAG with Excel files using SQL Agents.
  ☆35Updated 8 months ago
• brian-lou / Training-Data-Extraction-Attack-on-LLMs
  This project explores training data extraction attacks on the LLaMa 7B, GPT-2XL, and GPT-2-IMDB models to discover memorized content usin…
  ☆14Updated last year
• llm-proxy / llm-proxy
  ⚡Simplify and optimize the use of LLMs
  ☆25Updated last year
• langchain-ai / agentevals
  Readymade evaluators for agent trajectories
  ☆230Updated 2 weeks ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆281Updated 2 weeks ago
• awslabs / aiops-modules
  AIOps modules is a collection of reusable Infrastructure as Code (IaC) modules for Machine Learning (ML), Foundation Models (FM), Large L…
  ☆78Updated last week
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆115Updated 3 weeks ago
• invariantlabs-ai / invariant
  Guardrails for secure and robust agent development
  ☆292Updated this week
• Clearbox-AI / nerpii
  A Python library to perform NER on structured data and generate PII with Faker
  ☆30Updated last year
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆419Updated last year
• whylabs / whylogs-proto
  Protobuf definition for WhyLogs format
  ☆14Updated 3 years ago