High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
☆229Jul 16, 2026Updated 2 months ago
Alternatives and similar repositories for hub
Users that are interested in hub are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆412Jun 18, 2026Updated 3 months ago
- Easily run integration tests for your backends☆255Nov 16, 2023Updated 2 years ago
- Sister project to OpenLLMetry, but in Go. Open-source observability for your LLM application, based on OpenTelemetry☆47Jan 17, 2026Updated 8 months ago
- Portable LLM - A rust library for LLM inference☆11Apr 13, 2024Updated 2 years ago
- The open source customer feature framework for B2Bs. Easily control how your product behaves and looks for different customers.☆48Jul 5, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Modern utility library and typescript typings for building JSON Schema documents☆14Nov 28, 2025Updated 10 months ago
- Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly a…☆97Sep 30, 2026Updated last week
- Self-hosted AI gateway in one Rust binary: OpenAI- and Anthropic-compatible API, routing with fallbacks, budgets, rate limits, logs and a…☆21Updated this week
- Open-source observability for your GenAI or LLM application, based on OpenTelemetry☆7,470Updated this week
- The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.☆637Nov 21, 2025Updated 10 months ago
- SVG React icon set for popular APIs, by the makers of Trigger.dev.☆15Nov 25, 2025Updated 10 months ago
- Rust agent orchestration library for tool-using, long-horizon, traceable AI systems.☆14Sep 30, 2026Updated last week
- OpenTelemetry Instrumentation for AI Observability☆1,255Updated this week
- Easily sync open-policy rules to your feature toggles☆146Jul 9, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc…☆95Updated this week
- LLM proxy with built-in DLP and regulatory compliance. Redacts secrets before they reach the API. EU AI Act, GDPR, HDS/PCI DSS ready. Mul…☆20Updated this week
- High-performance framework for building interactive workflow systems in Rust. Designed for complex workflows and multi-agent systems☆379Sep 7, 2026Updated last month
- Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails…☆7,080Sep 28, 2026Updated last week
- Sister project to OpenLLMetry, but in Ruby. Open-source observability for your LLM application, based on OpenTelemetry☆15Apr 6, 2026Updated 6 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆789Updated this week
- Next Generation Agentic Proxy for AI Agents and MCP servers☆5,196Updated this week
- OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI…☆2,819Updated this week
- Refact for Visual Studio is a free, open-source AI code assistant☆16Jul 20, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AI context observability & optimization for Claude Code, Copilot CLI, Codex, Gemini — TUI dashboard, preset optimization, cost tracking, …☆14Sep 16, 2026Updated 3 weeks ago
- ⚙️🦀 Build modular and scalable LLM Applications in Rust☆8,811Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆6,201Sep 16, 2026Updated 3 weeks ago
- ☆16May 21, 2024Updated 2 years ago
- The official Rust SDK for the Model Context Protocol☆3,980Updated this week
- Redis Observability using eBPF☆21Sep 17, 2024Updated 2 years ago
- Durable execution framework for Rust☆20Feb 22, 2026Updated 7 months ago
- Guardrail capabilities for Pydantic AI — cost tracking, prompt injection detection, PII filtering, secret redaction, tool permissions, an…☆94Sep 21, 2026Updated 2 weeks ago
- Observability World for WASI☆28Mar 5, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆68Jul 2, 2024Updated 2 years ago
- OminiX API Server to support LLM, image, ASR and TTS☆34Aug 17, 2026Updated last month
- Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.☆11,610Updated this week
- Mechanism for generating ffi bindings between node and rust using uniffi☆22Jun 25, 2026Updated 3 months ago
- An OCI/Docker container registry crate, written in Rust☆16Aug 14, 2024Updated 2 years ago
- Useful Slack utility that helps you send messages to all members in a specific Slack community☆24Jan 4, 2024Updated 2 years ago
- to schedule jobs per node in kubernetes cluster☆11Jul 10, 2026Updated 2 months ago