Alternatives and similar repositories for artkit

Users that are interested in artkit are comparing it to the libraries listed below

• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆184Updated last year
• compl-ai / compl-ai
  An open-source compliance-centered evaluation framework for Generative AI models
  ☆158Updated last week
• EthicalML / fml-security
  Practical examples of "Flawed Machine Learning Security" together with ML Security best practice across the end to end stages of the mach…
  ☆112Updated 3 years ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆423Updated last year
• aiverify-foundation / aiverify
  AI Verify
  ☆23Updated this week
• lakshmanok / generative-ai-design-patterns
  A catalog of design patterns when building generative AI applications
  ☆164Updated last week
• jjallaire / inspect-llm-workshop
  ☆53Updated last year
• mostly-ai / mostlyai
  Synthetic Data SDK ✨
  ☆608Updated this week
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆135Updated last month
• stanford-crfm / EUAIActJune15
  Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
  ☆94Updated last year
• GoogleCloudPlatform / automlops
  Build MLOps Pipelines in Minutes
  ☆246Updated last week
• cvs-health / langfair
  LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
  ☆219Updated this week
• PAIR-code / llm-comparator
  LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR t…
  ☆454Updated 5 months ago
• JohnSnowLabs / langtest
  Deliver safe & effective language models
  ☆529Updated this week
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆246Updated 4 months ago
• whyhow-ai / whyhow
  Automated knowledge graph creation SDK
  ☆122Updated 7 months ago
• aiverify-foundation / moonshot
  Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
  ☆258Updated this week
• wandb / wandbot
  wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk
  ☆302Updated last week
• quotient-ai / judges
  A small library of LLM judges
  ☆232Updated 3 weeks ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆123Updated last week
• superwise-ai / elemeta
  Metafeature Extraction for Unstructured Data
  ☆102Updated 4 months ago
• trubrics / trubrics-python
  Product analytics for AI Assistants
  ☆154Updated last month
• aishwaryaprabhat / goku
  GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling
  ☆130Updated 8 months ago
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆111Updated 10 months ago
• victordibia / llmx
  An API for Chat Fine-Tuned Large Language Models (llm)
  ☆87Updated 11 months ago
• truera / truera-examples
  Examples for TruEra users to get started!
  ☆26Updated last year
• citadel-ai / langcheck
  Simple, Pythonic building blocks to evaluate LLM applications.
  ☆230Updated last week
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆151Updated 9 months ago
• ZenGuard-AI / fast-llm-security-guardrails
  The fastest Trust Layer for AI Agents
  ☆138Updated last month
• statice / awesome-synthetic-data
  A curated list of awesome synthetic data tools (open source and commercial).
  ☆192Updated last year