BCG-X-Official / artkitLinks
Automated prompt-based testing and evaluation of Gen AI applications
☆152Updated 6 months ago
Alternatives and similar repositories for artkit
Users that are interested in artkit are comparing it to the libraries listed below
Sorting:
- Fiddler Auditor is a tool to evaluate language models.☆187Updated last year
- An open-source compliance-centered evaluation framework for Generative AI models☆163Updated last week
- A tool for evaluating LLMs☆424Updated last year
- AI Verify☆32Updated last week
- Practical examples of "Flawed Machine Learning Security" together with ML Security best practice across the end to end stages of the mach…☆118Updated 3 years ago
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆944Updated 9 months ago
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆93Updated last year
- Simple, Pythonic building blocks to evaluate LLM applications.☆237Updated this week
- The fastest Trust Layer for AI Agents☆142Updated 3 months ago
- A small library of LLM judges☆280Updated last month
- ☆54Updated last year
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆191Updated 4 months ago
- Framework for LLM evaluation, guardrails and security☆113Updated last year
- A catalog of design patterns when building generative AI applications☆182Updated 2 weeks ago
- LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR t…☆477Updated 7 months ago
- A Lightweight Library for AI Observability☆251Updated 6 months ago
- Product analytics for AI Assistants☆154Updated 3 months ago
- Build MLOps Pipelines in Minutes☆247Updated last month
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆399Updated last year
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆151Updated 11 months ago
- This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire…☆235Updated this week
- A specification for OpenInference, a semantic mapping of ML inferences☆47Updated last year
- Moonshot - A simple and modular tool to evaluate and red-team any LLM application.☆267Updated last week
- LangFair is a Python library for conducting use-case level LLM bias and fairness assessments☆231Updated last week
- Red-Teaming Language Models with DSPy☆212Updated 7 months ago
- wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk☆306Updated 3 weeks ago
- ☆163Updated 7 months ago
- LLM Prompt Injection Detector☆1,343Updated last year
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆139Updated 3 weeks ago
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆247Updated 11 months ago