BCG-X-Official / artkitLinks
Automated prompt-based testing and evaluation of Gen AI applications
☆149Updated 3 months ago
Alternatives and similar repositories for artkit
Users that are interested in artkit are comparing it to the libraries listed below
Sorting:
- Fiddler Auditor is a tool to evaluate language models.☆183Updated last year
- Product analytics for AI Assistants☆153Updated last month
- A tool for evaluating LLMs☆419Updated last year
- ☆89Updated last year
- Sample notebooks and prompts for LLM evaluation☆134Updated 2 weeks ago
- An intuitive LLM prompting framework for multifunctional agents, by explicitly constructing a complex "thought process" from simple natur…☆452Updated 6 months ago
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆395Updated last year
- FastAPI wrapper around DSPy☆250Updated last year
- The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…☆242Updated 8 months ago
- A Lightweight Library for AI Observability☆246Updated 4 months ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated last year
- Automated knowledge graph creation SDK☆122Updated 6 months ago
- A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profil…☆78Updated last year
- LLM-powered RAG Question Answering Slack bot for DataTalksClub Zoomcamps☆56Updated 3 weeks ago
- Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in productio…☆89Updated last year
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆233Updated 7 months ago
- A Python client for the Unstructured Platform API☆104Updated this week
- Synthetic Data Engine 💎☆63Updated this week
- ☆87Updated last year
- ☆78Updated last year
- Metafeature Extraction for Unstructured Data☆102Updated 3 months ago
- ☆167Updated last year
- An Awesome list of curated DSPy resources.☆348Updated 4 months ago
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆111Updated 9 months ago
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆924Updated 7 months ago
- Examples for TruEra users to get started!☆26Updated last year
- Pebblo enables developers to safely load data and promote their Gen AI app to deployment☆145Updated this week
- Practical examples of "Flawed Machine Learning Security" together with ML Security best practice across the end to end stages of the mach…☆111Updated 3 years ago
- Visualization for a Retrieval-Augmented Generation (RAG) Assistant 🤖❤️📚☆190Updated 6 months ago
- Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)☆264Updated last year