Alternatives and similar repositories for inference-server

Users that are interested in inference-server are comparing it to the libraries listed below

• cloudevents / sdk-python
  Python SDK for CloudEvents
  ☆329Updated this week
• AlmogBaku / pytest-evals
  A pytest plugin for running and analyzing LLM evaluation tests.
  ☆148Updated 11 months ago
• astronomer / ask-astro
  An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
  ☆278Updated 5 months ago
• kpn / kstreams
  Library/micro framework to create streaming applications with kafka in a fast way
  ☆41Updated this week
• JasperHG90 / uv-monorepo
  Example of a monorepo setup for python projects using uv
  ☆148Updated 9 months ago
• combinator-ml / combinator
  Combinator.ml's central repo, documentation and website
  ☆30Updated 4 years ago
• Arize-ai / openinference
  OpenTelemetry Instrumentation for AI Observability
  ☆794Updated this week
• drivendataorg / erdantic
  Entity relationship diagrams for Python data model classes like Pydantic
  ☆401Updated 3 months ago
• pydantic / genai-prices
  Calculate prices for calling LLM inference APIs.
  ☆200Updated last week
• dudil / fastapi_msal
  A FastAPI Plug-In to support authentication authorization using the Microsoft Authentication Library (MSAL)
  ☆60Updated 3 months ago
• tomsharp / fastapi-on-ecs
  Starter code for deploying a FastAPI app on AWS ECS
  ☆15Updated last year
• outerbounds / metaflow-tools
  Tools and utilities for operating Metaflow in production
  ☆66Updated last month
• superlinear-ai / substrate
  🌱 Substrate is a modern Copier template for scaffolding Python packages and apps
  ☆342Updated 2 weeks ago
• FlorianWilhelm / the-hatchlor
  🌹 Cookiecutter template featuring the modern and extensible Python project manager hatch
  ☆81Updated last year
• pydantic / pydantic-ai-gateway
  ☆151Updated this week
• mostly-ai / mostlyai
  Synthetic Data SDK ✨
  ☆699Updated this week
• cbornet / blockbuster
  Utility to detect blocking calls in the async event loop
  ☆70Updated last month
• DavidVujic / python-polylith-example-uv
  Example Polylith setup for Python and uv
  ☆49Updated 2 weeks ago
• christo-olivier / modelsmith
  Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …
  ☆81Updated 3 months ago
• langfuse / langfuse-python
  🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …
  ☆325Updated this week
• takikadiri / kedro-boot
  A kedro plugin that streamlines the integration between Kedro projects and third-party applications, making it easier for you to develop…
  ☆43Updated last month
• genomoncology / FuzzTypes
  Pydantic extension for annotating autocorrecting fields.
  ☆221Updated last year
• flyteorg / flytekit
  Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
  ☆300Updated this week
• outerbounds / generative-ai-summit-austin-2023
  ☆25Updated last year
• preset-io / promptimize
  Promptimize is a prompt engineering evaluation and testing toolkit.
  ☆488Updated last month
• MatsMoll / ml-kickstarter
  A project to kickstart your ML development
  ☆31Updated last year
• temporalio / samples-python
  Samples for working with the Temporal Python SDK
  ☆288Updated 3 weeks ago
• mike-oakley / openapi-pydantic
  Modern, type-safe OpenAPI schemas in Python using Pydantic 1.8+ and 2.x
  ☆113Updated last month
• opendatahub-io / opendatahub-community
  ☆30Updated last month
• AltimateAI / awesome-data-contracts
  A curated list of awesome blogs, videos, tools and resources about Data Contracts
  ☆181Updated last year