High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
☆225Jul 16, 2026Updated last month
Alternatives and similar repositories for hub
Users that are interested in hub are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆410Jun 18, 2026Updated 2 months ago
- Easily run integration tests for your backends☆255Nov 16, 2023Updated 2 years ago
- Sister project to OpenLLMetry, but in Go. Open-source observability for your LLM application, based on OpenTelemetry☆46Jan 17, 2026Updated 7 months ago
- Portable LLM - A rust library for LLM inference☆11Apr 13, 2024Updated 2 years ago
- Modern utility library and typescript typings for building JSON Schema documents☆14Nov 28, 2025Updated 8 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly a…☆96Updated this week
- AI gateway built in Rust with advanced routing, caching, and monitoring capabilities.☆21Aug 23, 2025Updated last year
- Open-source observability for your GenAI or LLM application, based on OpenTelemetry☆7,391Aug 10, 2026Updated last week
- The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.☆624Nov 21, 2025Updated 9 months ago
- SVG React icon set for popular APIs, by the makers of Trigger.dev.☆15Nov 25, 2025Updated 8 months ago
- A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format☆108Updated this week
- Rust agent orchestration library for tool-using, long-horizon, traceable AI systems.☆14Aug 4, 2026Updated 2 weeks ago
- OpenTelemetry Instrumentation for AI Observability☆1,166Updated this week
- ScoreBar: A menu bar app for Mac that keeps you updated with the LIVE Cricket Score, without being a distraction during work hours.☆18Jan 13, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc…☆93Updated this week
- LLM proxy with built-in DLP and regulatory compliance. Redacts secrets before they reach the API. EU AI Act, GDPR, HDS/PCI DSS ready. Mul…☆20Aug 6, 2026Updated 2 weeks ago
- High-performance framework for building interactive workflow systems in Rust. Designed for complex workflows and multi-agent systems☆362Jul 19, 2026Updated last month
- Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails…☆7,015Updated this week
- AI that turns website functionality into python APIs! Control websites through python and AI!☆106Aug 4, 2024Updated 2 years ago
- Agent-first Rust/Axum backend harness for SDD-driven Clean/Hexagonal/DDD services, ECS-style runtime composition, counter-service referen…☆48May 24, 2026Updated 2 months ago
- Open-source options gamma exposure (GEX) & positioning dashboard — dealer GEX, max pain, open interest, IV surface. Self-hosted, Docker, …☆55Updated this week
- Sister project to OpenLLMetry, but in Ruby. Open-source observability for your LLM application, based on OpenTelemetry☆14Apr 6, 2026Updated 4 months ago
- By scanning CI/CD misconfigurations, Allero helps reduce production issues, harden your security posture and shift-left CI/CD from DevOps…☆203Jul 18, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆774Updated this week
- Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Manageme…☆2,714Updated this week
- Next Generation Agentic Proxy for AI Agents and MCP servers☆4,491Updated this week
- AI context observability & optimization for Claude Code, Copilot CLI, Codex, Gemini — TUI dashboard, preset optimization, cost tracking, …☆14Aug 5, 2026Updated 2 weeks ago
- ⚙️🦀 Build modular and scalable LLM Applications in Rust☆8,370Updated this week
- The open-source AI agent control plane: MCP firewall, model gateway with budgets, human approvals, runtime observability, and audit trail…☆48Updated this week
- The official Rust SDK for the Model Context Protocol☆3,832Updated this week
- Redis Observability using eBPF☆21Sep 17, 2024Updated last year
- Lightweight framework for structured and repeatable model validation☆11Jan 8, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Durable execution framework for Rust☆20Feb 22, 2026Updated 6 months ago
- Langtrace SDK for Python Applications☆45Jul 24, 2025Updated last year
- Guardrail capabilities for Pydantic AI — cost tracking, prompt injection detection, PII filtering, secret redaction, tool permissions, an…☆92Aug 14, 2026Updated last week
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆67Jul 2, 2024Updated 2 years ago
- Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.☆11,248Updated this week
- Mechanism for generating ffi bindings between node and rust using uniffi☆22Jun 25, 2026Updated last month
- "rust-openai-chatgpt-api" is a Rust library for accessing the ChatGPT API, a powerful NLP platform by OpenAI. The library provides a simp…☆11Jul 19, 2026Updated last month