whylabs / langkitLinks
🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
☆975Updated last year
Alternatives and similar repositories for langkit
Users that are interested in langkit are comparing it to the libraries listed below
Sorting:
- A tool for evaluating LLMs☆427Updated last year
- LLM Prompt Injection Detector☆1,399Updated last year
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆399Updated 2 years ago
- Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.☆868Updated last year
- ☆780Updated 7 months ago
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone☆1,027Updated last year
- Fine-Tuning Embedding for RAG with Synthetic Data☆523Updated 2 years ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,998Updated last year
- ☆993Updated 2 months ago
- ☆470Updated 2 years ago
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆321Updated 6 months ago
- Open-source tool to visualise your RAG 🔮☆1,213Updated last year
- ☆507Updated last year
- Automated Evaluation of RAG Systems☆684Updated 9 months ago
- VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…☆699Updated last year
- Evaluation and Tracking for LLM Experiments and AI Agents☆3,039Updated last week
- 🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.☆728Updated this week
- The Security Toolkit for LLM Interactions☆2,444Updated last month
- Deliver safe & effective language models☆553Updated last week
- Python SDK for running evaluations on LLM generated responses☆295Updated 7 months ago
- Evaluation tool for LLM QA chains☆1,091Updated 2 years ago
- Promptimize is a prompt engineering evaluation and testing toolkit.☆490Updated last week
- Adala: Autonomous DAta (Labeling) Agent framework☆1,350Updated this week
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,458Updated this week
- An LLM-powered advanced RAG pipeline built from scratch☆856Updated 2 years ago
- 🦙 Integrating LLMs into structured NLP pipelines☆1,362Updated last year
- A comprehensive guide to building RAG-based LLM applications for production.☆1,844Updated last year
- ☆905Updated last year
- Scale LLM Engine public repository☆819Updated this week