High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
☆226Jul 16, 2026Updated 2 months ago
Alternatives and similar repositories for hub
Users that are interested in hub are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆411Jun 18, 2026Updated 2 months ago
- Portable LLM - A rust library for LLM inference☆11Apr 13, 2024Updated 2 years ago
- The open source customer feature framework for B2Bs. Easily control how your product behaves and looks for different customers.☆48Jul 5, 2023Updated 3 years ago
- Modern utility library and typescript typings for building JSON Schema documents☆14Nov 28, 2025Updated 9 months ago
- Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly a…☆97Aug 24, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AI gateway built in Rust with advanced routing, caching, and monitoring capabilities.☆21Aug 23, 2025Updated last year
- Open-source observability for your GenAI or LLM application, based on OpenTelemetry☆7,434Aug 10, 2026Updated last month
- The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.☆629Nov 21, 2025Updated 9 months ago
- A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format☆113Updated this week
- OpenTelemetry Instrumentation for AI Observability☆1,221Updated this week
- Easily sync open-policy rules to your feature toggles☆146Jul 9, 2024Updated 2 years ago
- The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc…☆94Updated this week
- LLM proxy with built-in DLP and regulatory compliance. Redacts secrets before they reach the API. EU AI Act, GDPR, HDS/PCI DSS ready. Mul…☆20Sep 3, 2026Updated 2 weeks ago
- High-performance framework for building interactive workflow systems in Rust. Designed for complex workflows and multi-agent systems☆373Sep 7, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails…☆7,055Aug 19, 2026Updated 3 weeks ago
- Agent-first Rust/Axum backend harness for SDD-driven Clean/Hexagonal/DDD services, ECS-style runtime composition, counter-service referen…☆49May 24, 2026Updated 3 months ago
- Sister project to OpenLLMetry, but in Ruby. Open-source observability for your LLM application, based on OpenTelemetry☆14Apr 6, 2026Updated 5 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆781Updated this week
- Next Generation Agentic Proxy for AI Agents and MCP servers☆4,883Updated this week
- Open-source observability & evaluation platform for AI agents and coding agents. Trace LLMs, tools, prompts, costs & agent workflows with…☆2,769Updated this week
- AI context observability & optimization for Claude Code, Copilot CLI, Codex, Gemini — TUI dashboard, preset optimization, cost tracking, …☆14Aug 5, 2026Updated last month
- ⚙️🦀 Build modular and scalable LLM Applications in Rust☆8,646Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆6,160Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Collection of my personal helper scripts.☆14Sep 6, 2026Updated last week
- The official Rust SDK for the Model Context Protocol☆3,933Updated this week
- Redis Observability using eBPF☆21Sep 17, 2024Updated 2 years ago
- Lightweight framework for structured and repeatable model validation☆11Jan 8, 2026Updated 8 months ago
- ☆12Jan 21, 2024Updated 2 years ago
- Guardrail capabilities for Pydantic AI — cost tracking, prompt injection detection, PII filtering, secret redaction, tool permissions, an…☆94Updated this week
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆68Jul 2, 2024Updated 2 years ago
- OminiX API Server to support LLM, image, ASR and TTS☆34Aug 17, 2026Updated last month
- Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.☆11,436Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- "rust-openai-chatgpt-api" is a Rust library for accessing the ChatGPT API, a powerful NLP platform by OpenAI. The library provides a simp…☆11Jul 19, 2026Updated last month
- Mechanism for generating ffi bindings between node and rust using uniffi☆22Jun 25, 2026Updated 2 months ago
- An OCI/Docker container registry crate, written in Rust☆16Aug 14, 2024Updated 2 years ago
- ☆18Jul 6, 2026Updated 2 months ago
- to schedule jobs per node in kubernetes cluster☆11Jul 10, 2026Updated 2 months ago
- LLM Gateway to call 100+ LLM APIs in OpenAI format with MCP supported.☆31Oct 2, 2025Updated 11 months ago
- Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <10…☆8,116Updated this week