Open-source observability for your GenAI or LLM application, based on OpenTelemetry
☆7,046Apr 27, 2026Updated this week
Alternatives and similar repositories for openllmetry
Users that are interested in openllmetry are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy serverless AI workflows at scale. Firebase for AI agents☆6,603Mar 13, 2026Updated last month
- Generate, animate and schedule your AI characters 🤖☆3,371Jun 23, 2025Updated 10 months ago
- The open-source AIOps and alert management platform☆11,669Updated this week
- The Ultimate all-in social media automation (outreach) tool 🤖☆3,321Oct 13, 2025Updated 6 months ago
- The Classiq Library is the largest collection of quantum algorithms and applications. It is the best way to explore quantum computing sof…☆2,003Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Unified framework for building enterprise RAG pipelines with small, specialized models☆14,873Apr 14, 2026Updated 2 weeks ago
- Turns Data and AI algorithms into production-ready web applications in no time.☆19,177Updated this week
- Digger is an open source IaC orchestration tool. Digger allows you to run IaC in your existing CI pipeline ⚡️☆4,922Updated this week
- Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents th…☆27,938Updated this week
- 📨 The ultimate agentic social media scheduling tool 🤖☆29,789Updated this week
- ToolJet is the open-source foundation of ToolJet AI - the enterprise app generation platform for building internal tools, dashboard, busi…☆37,811Updated this week
- The Frontend Stack for Agents & Generative UI. React + Angular. Makers of the AG-UI Protocol☆30,521Updated this week
- Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Manageme…☆2,394Apr 23, 2026Updated last week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…☆26,353Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- AI Observability & Evaluation☆9,459Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆5,576Apr 23, 2026Updated last week
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆396Updated this week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆45,153Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆13,709Feb 24, 2026Updated 2 months ago
- The LLM Evaluation Framework☆14,993Updated this week
- DSPy: The framework for programming—not prompting—language models☆34,016Apr 24, 2026Updated last week
- structured outputs for llms☆12,840Apr 22, 2026Updated last week
- Laminar - open-source observability platform purpose-built for AI agents. YC S24.☆2,803Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Structured Outputs☆13,741Apr 16, 2026Updated 2 weeks ago
- Adding guardrails to large language models.☆6,777Apr 3, 2026Updated 3 weeks ago
- OpenTelemetry Instrumentation for AI Observability☆944Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆24,994Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆11,434Mar 25, 2026Updated last month
- LlamaIndex is the leading document agent and OCR platform☆48,997Updated this week
- Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Ll…☆20,722Updated this week
- Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…☆5,500Mar 19, 2026Updated last month
- Easily run integration tests for your backends☆255Nov 16, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ cl…☆9,894Updated this week
- Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations,…☆19,126Updated this week
- AI Agent Framework, the Pydantic way☆16,722Updated this week
- Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, ev…☆1,193Nov 17, 2025Updated 5 months ago
- Build Conversational AI in minutes ⚡️☆12,005Apr 24, 2026Updated last week
- Build, run, manage agentic software at scale.☆39,659Updated this week
- Universal memory layer for AI Agents☆54,199Updated this week