traceloop / hub
High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
☆62Updated last week
Alternatives and similar repositories for hub:
Users that are interested in hub are comparing it to the libraries listed below
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆61Updated last week
- Multi-language code navigation API in a container☆76Updated 2 weeks ago
- Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly a…☆58Updated last month
- Python client for accessing the turbopuffer API.☆45Updated this week
- Open-source AI copilot that lets you chat with your observability data and code 🧙♂️☆345Updated last week
- AI aware proxy☆18Updated 7 months ago
- 🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps☆147Updated 8 months ago
- Manage / Proxy / Secure your MCP Servers☆66Updated 3 weeks ago
- Run AI generated code in isolated sandboxes☆63Updated 3 months ago
- A multi-language source code analyzer and docstrings parser☆62Updated last year
- The home of official Obot tools☆29Updated this week
- Spin SDK for Python☆40Updated last month
- An example of a RAG backend plus UI☆45Updated 4 months ago
- Foyle is a copilot to help developers deploy and operate their applications.☆127Updated last month
- Structured outputs for LLMs☆46Updated 9 months ago
- Knowledge for GPTScript☆29Updated 6 months ago
- Python SDK for running evaluations on LLM generated responses☆278Updated last week
- TonboLite: Analysis-ready SQLite using Tonbo☆43Updated last month
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆97Updated 6 months ago
- ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.☆17Updated this week
- A Kubernetes operator for managing Prefect servers and work pools☆13Updated this week
- Guards and protection agnostic to your model or provider☆36Updated 5 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆93Updated 2 months ago
- Stateful Dataflows tutorials and examples.☆33Updated 3 weeks ago
- Rust crates for XetHub☆43Updated 6 months ago
- Model Context Protocol Server for Apache OpenDAL™☆28Updated 3 weeks ago
- Securely run AI-generated code in stateful sandboxes that run forever.☆183Updated 2 weeks ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆35Updated last week
- ☆44Updated 4 months ago
- graph + ai in your products; reduce costs and get correct answers from your data☆40Updated this week