BCG-X-Official / artkitLinks
Automated prompt-based testing and evaluation of Gen AI applications
☆159Updated 8 months ago
Alternatives and similar repositories for artkit
Users that are interested in artkit are comparing it to the libraries listed below
Sorting:
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- Framework for LLM evaluation, guardrails and security☆113Updated last year
- An open-source compliance-centered evaluation framework for Generative AI models☆172Updated 2 weeks ago
- A tool for evaluating LLMs☆428Updated last year
- Practical examples of "Flawed Machine Learning Security" together with ML Security best practice across the end to end stages of the mach…☆120Updated 3 years ago
- A small library of LLM judges☆302Updated 4 months ago
- Simple, Pythonic building blocks to evaluate LLM applications.☆245Updated 3 weeks ago
- ☆163Updated 9 months ago
- ☆74Updated last year
- AI Verify☆37Updated 3 weeks ago
- The fastest Trust Layer for AI Agents☆145Updated 6 months ago
- Red-Teaming Language Models with DSPy☆238Updated 9 months ago
- Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act☆93Updated 2 years ago
- Moonshot - A simple and modular tool to evaluate and red-team any LLM application.☆285Updated 2 months ago
- A Lightweight Library for AI Observability☆251Updated 9 months ago
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆116Updated 4 months ago
- 🧪 Experimental features for Haystack☆57Updated this week
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆83Updated last year
- Test Software for the Characterization of AI Technologies☆265Updated this week
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆107Updated 11 months ago
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆134Updated last year
- Build MLOps Pipelines in Minutes☆250Updated 3 months ago
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆247Updated last year
- A programming framework for agentic AI. Discord: https://discord.gg/pAbnFJrkgZ☆137Updated 9 months ago
- LangFair is a Python library for conducting use-case level LLM bias and fairness assessments☆242Updated last week
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆964Updated last year
- An intuitive LLM prompting framework for multifunctional agents, by explicitly constructing a complex "thought process" from simple natur…☆470Updated 11 months ago
- A framework for fine-tuning retrieval-augmented generation (RAG) systems.☆136Updated this week
- RAG orchestration framework ⛵️☆201Updated 4 months ago
- wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk☆310Updated last month