whylabs / langkit
🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
☆889Updated 4 months ago
Alternatives and similar repositories for langkit:
Users that are interested in langkit are comparing it to the libraries listed below
- LLM Prompt Injection Detector☆1,208Updated 7 months ago
- A tool for evaluating LLMs☆407Updated 10 months ago
- Evaluation and Tracking for LLM Experiments☆2,389Updated this week
- ☆761Updated last year
- Adding guardrails to large language models.☆4,646Updated last week
- ☆857Updated 3 months ago
- 🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.☆566Updated this week
- Open-source tool to visualise your RAG 🔮☆1,115Updated 2 months ago
- OpenTelemetry Instrumentation for AI Observability☆339Updated this week
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone☆1,007Updated 4 months ago
- Automatically evaluate your LLMs in Google Colab☆603Updated 10 months ago
- Superfast AI decision making and intelligent processing of multi-modal data.☆2,473Updated last week
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆288Updated 4 months ago
- ☆497Updated 7 months ago
- An LLM-powered advanced RAG pipeline built from scratch☆830Updated last year
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,815Updated 7 months ago
- A tiny library for coding with large language models.☆1,225Updated 8 months ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,263Updated last week
- A comprehensive guide to building RAG-based LLM applications for production.☆1,778Updated 7 months ago
- Fine-Tuning Embedding for RAG with Synthetic Data☆487Updated last year
- Fiddler Auditor is a tool to evaluate language models.☆176Updated last year
- The Security Toolkit for LLM Interactions☆1,513Updated this week
- Evaluation tool for LLM QA chains☆1,071Updated last year
- Ship RAG based LLM web apps in seconds.☆987Updated last year
- ☆449Updated last year
- Python SDK for running evaluations on LLM generated responses☆272Updated this week
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆392Updated last year
- The production toolkit for LLMs. Observability, prompt management and evaluations.☆1,229Updated this week
- A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research …☆946Updated 3 months ago
- ☆1,458Updated last year