Open-source observability for your GenAI or LLM application, based on OpenTelemetry
☆6,985Apr 8, 2026Updated this week
Alternatives and similar repositories for openllmetry
Users that are interested in openllmetry are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy serverless AI workflows at scale. Firebase for AI agents☆6,605Mar 13, 2026Updated 3 weeks ago
- Generate, animate and schedule your AI characters 🤖☆3,372Jun 23, 2025Updated 9 months ago
- The open-source AIOps and alert management platform☆11,593Apr 2, 2026Updated last week
- The Ultimate all-in social media automation (outreach) tool 🤖☆3,294Oct 13, 2025Updated 5 months ago
- The Classiq Library is the largest collection of quantum algorithms and applications. It is the best way to explore quantum computing sof…☆1,990Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Unified framework for building enterprise RAG pipelines with small, specialized models☆14,858Mar 26, 2026Updated 2 weeks ago
- Turns Data and AI algorithms into production-ready web applications in no time.☆19,153Apr 2, 2026Updated last week
- Digger is an open source IaC orchestration tool. Digger allows you to run IaC in your existing CI pipeline ⚡️☆4,895Apr 3, 2026Updated last week
- Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents th…☆27,670Updated this week
- 📨 The ultimate social media scheduling tool, with a bunch of AI 🤖☆27,967Updated this week
- ToolJet is the open-source foundation of ToolJet AI - the enterprise app generation platform for building internal tools, dashboard, busi…☆37,716Updated this week
- The Frontend Stack for Agents & Generative UI. React + Angular. Makers of the AG-UI Protocol☆30,109Updated this week
- Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Manageme…☆2,355Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆24,655Updated this week
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- AI Observability & Evaluation☆9,201Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆5,463Updated this week
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆393Updated this week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆42,652Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆13,295Feb 24, 2026Updated last month
- The LLM Evaluation Framework☆14,519Updated this week
- DSPy: The framework for programming—not prompting—language models☆33,495Apr 2, 2026Updated last week
- structured outputs for llms☆12,702Apr 3, 2026Updated last week
- Structured Outputs☆13,631Mar 26, 2026Updated 2 weeks ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Laminar - open-source observability platform purpose-built for AI agents. YC S24.☆2,757Updated this week
- Adding guardrails to large language models.☆6,647Apr 3, 2026Updated last week
- OpenTelemetry Instrumentation for AI Observability☆912Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,720Apr 3, 2026Updated last week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆11,196Mar 25, 2026Updated 2 weeks ago
- LlamaIndex is the leading document agent and OCR platform☆48,389Updated this week
- Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Ll…☆19,810Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,443Mar 19, 2026Updated 3 weeks ago
- Easily run integration tests for your backends☆255Nov 16, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations,…☆18,745Updated this week
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ cl…☆9,760Updated this week
- Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…☆1,189Nov 17, 2025Updated 4 months ago
- AI Agent Framework, the Pydantic way☆16,185Updated this week
- Build Conversational AI in minutes ⚡️☆11,867Updated this week
- Build, run, manage agentic software at scale.☆39,153Apr 3, 2026Updated last week
- Universal memory layer for AI Agents☆52,137Updated this week