whylabs / langkit
🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
☆876Updated 2 months ago
Alternatives and similar repositories for langkit:
Users that are interested in langkit are comparing it to the libraries listed below
- LLM Prompt Injection Detector☆1,179Updated 6 months ago
- A tool for evaluating LLMs☆400Updated 9 months ago
- Fine-Tuning Embedding for RAG with Synthetic Data☆483Updated last year
- Evaluation and Tracking for LLM Experiments☆2,315Updated this week
- Automated Evaluation of RAG Systems☆545Updated 3 months ago
- ☆756Updated last year
- ☆446Updated last year
- Open-source tool to visualise your RAG 🔮☆1,106Updated last month
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆389Updated last year
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆282Updated 3 months ago
- Superfast AI decision making and intelligent processing of multi-modal data.☆2,381Updated this week
- The Security Toolkit for LLM Interactions☆1,402Updated last month
- Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…☆720Updated this week
- Fiddler Auditor is a tool to evaluate language models.☆175Updated 11 months ago
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,175Updated this week
- The production toolkit for LLMs. Observability, prompt management and evaluations.☆1,168Updated this week
- Ship RAG based LLM web apps in seconds.☆983Updated last year
- 🦜💯 Flex those feathers!☆239Updated 3 months ago
- Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.☆817Updated 3 months ago
- wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk☆288Updated 2 weeks ago
- LangSmith Client SDK Implementations☆477Updated this week
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone☆1,000Updated 3 months ago
- A library for prompt engineering and optimization (SAMMO = Structure-aware Multi-Objective Metaprompt Optimization)☆635Updated last month
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,284Updated this week
- Python SDK for running evaluations on LLM generated responses☆266Updated this week
- Build robust LLM applications with true composability 🔗☆415Updated last year
- OpenTelemetry Instrumentation for AI Observability☆293Updated this week
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…☆746Updated 2 months ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆870Updated last month
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,789Updated 6 months ago