jpmorganchase / inference-serverLinks
Deploy your AI/ML model to Amazon SageMaker for Real-Time Inference and Batch Transform using your own Docker container image.
☆56Updated 10 months ago
Alternatives and similar repositories for inference-server
Users that are interested in inference-server are comparing it to the libraries listed below
Sorting:
- An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer☆280Updated 6 months ago
- Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.☆306Updated this week
- AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kub…☆327Updated 7 months ago
- A pytest plugin for running and analyzing LLM evaluation tests.☆153Updated last year
- Python SDK for CloudEvents☆330Updated 3 weeks ago
- Tools and utilities for operating Metaflow in production☆68Updated 3 months ago
- An fsspec implementation for the lakeFS project☆61Updated 3 weeks ago
- Workshop "From zero to MLOps: An open source stack to fight spaghetti ML"☆25Updated last year
- OpenTelemetry Instrumentation for AI Observability☆851Updated this week
- Joining the modern data stack with the modern ML stack☆201Updated 2 years ago
- Python Stream Processing☆1,953Updated 10 months ago
- Entity relationship diagrams for Python data model classes like Pydantic☆400Updated 4 months ago
- Prepare requirements and deploy Flyte using Helm☆82Updated 10 months ago
- Deploy production-grade Metaflow cloud infrastructure on AWS☆70Updated last month
- Example of a monorepo setup for python projects using uv☆155Updated 10 months ago
- Flyte Documentation 📖☆86Updated 10 months ago
- Build MLOps Pipelines in Minutes☆255Updated 3 weeks ago
- Pydantic extension for annotating autocorrecting fields.☆222Updated last year
- Python monorepo template with uv☆126Updated 9 months ago
- deployKF builds machine learning platforms on Kubernetes. We combine the best of Kubeflow, Airflow†, and MLflow† into a complete platform…☆466Updated last year
- Additional packages (components, document stores and the likes) to extend the capabilities of Haystack☆181Updated last week
- 🌱 Substrate is a modern Copier template for scaffolding Python packages and apps☆349Updated last month
- A set of IaC artifacts to automatically configure the infrastructure resources needed by a Flyte deployment☆32Updated 11 months ago
- A project to kickstart your ML development☆31Updated last year
- Start building and deploying Python packages and Docker images for MLOps tasks.☆431Updated 2 weeks ago
- Mlflow Docker Image☆24Updated last week
- Declarative context engineering for agents☆440Updated this week
- MLflow Tracking Server OIDC Auth plugin☆95Updated this week
- Open source project for data preparation for GenAI applications☆898Updated this week
- 🪢 Langfuse Python SDK - Instrument your LLM app with decorators or low-level SDK and get detailed tracing/observability. Works with any …☆342Updated this week