High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
☆221Jul 16, 2026Updated last week
Alternatives and similar repositories for hub
Users that are interested in hub are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆408Jun 18, 2026Updated last month
- Easily run integration tests for your backends☆255Nov 16, 2023Updated 2 years ago
- Sister project to OpenLLMetry, but in Go. Open-source observability for your LLM application, based on OpenTelemetry☆46Jan 17, 2026Updated 6 months ago
- Open-source options gamma exposure (GEX) & positioning dashboard — dealer GEX, max pain, open interest, IV surface. Self-hosted, Docker, …☆48Updated this week
- Portable LLM - A rust library for LLM inference☆12Apr 13, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly a…☆95Updated this week
- AI gateway built in Rust with advanced routing, caching, and monitoring capabilities.☆22Aug 23, 2025Updated 11 months ago
- Open-source observability for your GenAI or LLM application, based on OpenTelemetry☆7,339Jul 13, 2026Updated 2 weeks ago
- The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.☆615Nov 21, 2025Updated 8 months ago
- A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format☆104Updated this week
- Multi-agent simulation platform where AI agents self-organize on a Kanban board — built with LangGraph, Google A2A, and MCP.☆19Updated this week
- Rust agent orchestration library for tool-using, long-horizon, traceable AI systems.☆15Jul 15, 2026Updated 2 weeks ago
- OpenTelemetry Instrumentation for AI Observability☆1,119Updated this week
- Easily sync open-policy rules to your feature toggles☆146Jul 9, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc…☆88Updated this week
- LLM proxy with built-in DLP and regulatory compliance. Redacts secrets before they reach the API. EU AI Act, GDPR, HDS/PCI DSS ready. Mul…☆21Updated this week
- High-performance framework for building interactive workflow systems in Rust. Designed for complex workflows and multi-agent systems☆355Jul 19, 2026Updated last week
- Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails…☆6,911Updated this week
- AI that turns website functionality into python APIs! Control websites through python and AI!☆106Aug 4, 2024Updated last year
- Agent-first Rust/Axum backend harness for SDD-driven Clean/Hexagonal/DDD services, ECS-style runtime composition, counter-service referen…☆48May 24, 2026Updated 2 months ago
- Sister project to OpenLLMetry, but in Ruby. Open-source observability for your LLM application, based on OpenTelemetry☆14Apr 6, 2026Updated 3 months ago
- By scanning CI/CD misconfigurations, Allero helps reduce production issues, harden your security posture and shift-left CI/CD from DevOps…☆203Jul 18, 2023Updated 3 years ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆722Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Manageme…☆2,655Updated this week
- Next Generation Agentic Proxy for AI Agents and MCP servers☆4,113Updated this week
- AI context observability & optimization for Claude Code, Copilot CLI, Codex, Gemini — TUI dashboard, preset optimization, cost tracking, …☆14Jun 17, 2026Updated last month
- ⚙️🦀 Build modular and scalable LLM Applications in Rust☆8,088Updated this week
- The open-source AI agent control plane: MCP firewall, model gateway with budgets, human approvals, runtime observability, and audit trail…☆40Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆6,013Updated this week
- The official Rust SDK for the Model Context Protocol☆3,700Updated this week
- Redis Observability using eBPF☆21Sep 17, 2024Updated last year
- Langtrace SDK for Python Applications☆45Jul 24, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Guardrail capabilities for Pydantic AI — cost tracking, prompt injection detection, PII filtering, secret redaction, tool permissions, an…☆87Jul 22, 2026Updated last week
- GitHub Action which allows one to query his snowflake data warehouse☆16Jun 6, 2026Updated last month
- OminiX API Server to support LLM, image, ASR and TTS☆34Jul 2, 2026Updated 3 weeks ago
- Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.☆11,014Updated this week
- Mechanism for generating ffi bindings between node and rust using uniffi☆22Jun 25, 2026Updated last month
- "rust-openai-chatgpt-api" is a Rust library for accessing the ChatGPT API, a powerful NLP platform by OpenAI. The library provides a simp…☆11Jul 19, 2026Updated last week
- An OCI/Docker container registry crate, written in Rust☆15Aug 14, 2024Updated last year