whylabs / langkit
🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
☆870Updated 2 months ago
Alternatives and similar repositories for langkit:
Users that are interested in langkit are comparing it to the libraries listed below
- LLM Prompt Injection Detector☆1,166Updated 5 months ago
- The Security Toolkit for LLM Interactions☆1,373Updated 2 weeks ago
- A tool for evaluating LLMs☆398Updated 8 months ago
- ☆756Updated last year
- ☆828Updated last month
- 🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.☆543Updated this week
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,773Updated 5 months ago
- Evaluation and Tracking for LLM Experiments☆2,293Updated this week
- Python SDK for running evaluations on LLM generated responses☆258Updated this week
- Fine-Tuning Embedding for RAG with Synthetic Data☆480Updated last year
- Fiddler Auditor is a tool to evaluate language models.☆174Updated 10 months ago
- Open-source tool to visualise your RAG 🔮☆1,101Updated 3 weeks ago
- Evaluation tool for LLM QA chains☆1,066Updated last year
- 🦜💯 Flex those feathers!☆239Updated 3 months ago
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆638Updated last year
- Adding guardrails to large language models.☆4,410Updated this week
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆491Updated 7 months ago
- 🦙 Integrating LLMs into structured NLP pipelines☆1,174Updated 3 weeks ago
- A comprehensive guide to building RAG-based LLM applications for production.☆1,749Updated 5 months ago
- High quality resources & applications for LLMs, multi-modal models and VectorDBs☆681Updated this week
- ☆443Updated last year
- Promptimize is a prompt engineering evaluation and testing toolkit.☆444Updated 3 months ago
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆389Updated last year
- Automated Evaluation of RAG Systems☆532Updated 2 months ago
- ☆820Updated 3 months ago
- Efficient Retrieval Augmentation and Generation Framework☆1,428Updated 2 weeks ago
- ☆1,202Updated 9 months ago
- OpenTelemetry Instrumentation for AI Observability☆259Updated this week
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone☆997Updated 2 months ago
- wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk☆287Updated this week