traceloop / hub
High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
β56Updated this week
Alternatives and similar repositories for hub:
Users that are interested in hub are comparing it to the libraries listed below
- Open-source AI copilot that lets you chat with your observability data and code π§ββοΈβ339Updated 4 months ago
- Multi-language code navigation API in a containerβ72Updated this week
- Easily sync open-policy rules to your feature togglesβ129Updated 8 months ago
- Rust executable for Refact Agent, it lives inside your IDE and keeps AST and VecDB indexes up to date, offers agentic tools for an AI modβ¦β58Updated last month
- WebAssembly dev environment for Envoy Proxy. Iterate on your HTTP/TCP middleware in seconds!β55Updated last year
- TonboLite: Analysis-ready SQLite using Tonboβ42Updated last week
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetryβ300Updated this week
- [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applicationsβ158Updated 11 months ago
- Python SDK for running evaluations on LLM generated responsesβ272Updated last week
- EZQL ask your database questions using natural language.β127Updated 2 months ago
- Cedana: Access and run on compute anywhere in the world, on any provider. Migrate seamlessly between providers, arbitraging price/performβ¦β58Updated this week
- Python client for accessing the turbopuffer API.β38Updated this week
- A simple DAG for executing LLM calls and using tools.β41Updated last year
- This is a landscape of the infrastructure that powers the generative AI ecosystemβ139Updated 5 months ago
- See contextual info about code from your dev tools, in your editor, code review, and anywhere else you read code.β213Updated 3 weeks ago
- LLM Security Platform.β10Updated 4 months ago
- Protocol and libraries for sending and receiving OpenTelemetry data using Apache Arrowβ102Updated this week
- A Model Context Protocol (MCP) server implementation for DuckDB, providing database interaction capabilitiesβ74Updated this week
- Orchestrated process and container checkpointingβ77Updated this week
- A multi-language source code analyzer and docstrings parserβ59Updated last year
- Workflow orchestrator written in rustβ42Updated 2 months ago
- Refact - Open-Source AI Agent, Code Generator & Chat for JavaScript, Python, TypeScript, Java, PHP, Go, and more.β90Updated this week
- Easily run integration tests for your backendsβ256Updated last year
- Find the best ML model for your use case | Y Combinator Fall 2024β21Updated 5 months ago
- Guards and protection agnostic to your model or providerβ36Updated 4 months ago
- A gateway demo for MCP SSE Serverβ62Updated 3 months ago
- Structured outputs for LLMsβ42Updated 8 months ago
- β105Updated this week
- Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI seβ¦β181Updated this week
- Work with OpenAI's streaming API at ease with Python generatorsβ121Updated 10 months ago