whylabs / openllmtelemetryLinks
Open LLM Telemetry package
☆29Updated last year
Alternatives and similar repositories for openllmtelemetry
Users that are interested in openllmtelemetry are comparing it to the libraries listed below
Sorting:
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆969Updated last year
- Python SDK for running evaluations on LLM generated responses☆293Updated 6 months ago
- Elkar - Task management for AI Agents, ready for Agent2Agent (A2A) protocol☆144Updated 7 months ago
- A python package to make it easier to interact with WhyLabs APIs☆14Updated last year
- Framework for LLM evaluation, guardrails and security☆114Updated last year
- ☆74Updated last year
- OpenTelemetry Instrumentation for AI Observability☆777Updated this week
- Build Agents That Recall What Matters. Systematically engineer relevant context from chat history & business data. (Python Client)☆171Updated last week
- A project that enables identification and classification of an intent of a message with dynamic labels☆49Updated last year
- 🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …☆315Updated this week
- Agent Name Service (ANS) Protocol, introduced by the OWASP GenAI Security Project, is a foundational framework designed to facilitate sec…☆45Updated 7 months ago
- Pebblo enables developers to safely load data and promote their Gen AI app to deployment☆149Updated 6 months ago
- Model Context Protocol (MCP) Server for Langfuse Prompt Management. This server allows you to access and manage your Langfuse prompts thr…☆149Updated 10 months ago
- A simple MCP application that delivers curated positive and uplifting news stories.☆44Updated 5 months ago
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- A powerful, AI Gateway designed from scratch for AI☆48Updated this week
- Testing and evaluation framework for voice agents☆161Updated 6 months ago
- A powerful AI observability framework that provides comprehensive insights into agent interactions across platforms, enabling developers …☆103Updated 7 months ago
- 🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground an…☆154Updated this week
- This repository stems from our paper, “Cataloguing LLM Evaluations”, and serves as a living, collaborative catalogue of LLM evaluation fr…☆19Updated 2 years ago
- A practical RAG where you can download and chat with github repo☆95Updated 10 months ago
- AI aware proxy☆19Updated last year
- 🚀 Use NVIDIA NIMs with Haystack pipelines☆31Updated last year
- This is a Python package to add tool calling capabilities to newly released LLMs on LangChain's ChatOpenAI, AzureAIChatCompletionsModel a…☆121Updated 6 months ago
- The AI runtime that turns your framework functions into OpenAI compatible endpoints☆87Updated 10 months ago
- Named Entity Recognition using Claude Citations☆79Updated 6 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆54Updated last year
- ☆13Updated 2 months ago
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆108Updated last year
- This implementation follows the official MCP specification, including proper message framing, transport layer implementation, and complet…☆55Updated last year