awesome-mlops / awesome-ml-servingLinks
A curated list of awesome open source and commercial platforms for serving models in production π
β41Updated 3 years ago
Alternatives and similar repositories for awesome-ml-serving
Users that are interested in awesome-ml-serving are comparing it to the libraries listed below
Sorting:
- ClearML - Model-Serving Orchestration and Repository Solutionβ155Updated last month
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessβ¦β114Updated last year
- This project shows how to serve an ONNX-optimized image classification model as a web service with FastAPI, Docker, and Kubernetes.β220Updated 3 years ago
- Self-host LLMs with vLLM and BentoMLβ140Updated this week
- π² A curated list of MLOps projects, tools and resourcesβ186Updated last year
- Get started DVC projectβ60Updated last year
- Chassis turns machine learning models into portable container images that can run just about anywhere.β86Updated last year
- Dataset registry DVC projectβ80Updated last year
- BentoML Example Projects π¨β139Updated 7 months ago
- MLflow deployment with 1 commandβ210Updated this week
- Fine-tune an LLM to perform batch inference and online serving.β112Updated 3 months ago
- Source of the FSDL 2022 labs, which are at https://github.com/full-stack-deep-learning/fsdl-text-recognizer-2022-labsβ82Updated last year
- β16Updated 2 years ago
- Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zoβ463Updated last month
- Compare MLOps Platforms. Breakdowns of SageMaker, VertexAI, AzureML, Dataiku, Databricks, h2o, kubeflow, mlflow...β394Updated 2 years ago
- Hassle-free ML Pipelines on Kubernetesβ39Updated 2 years ago
- Simple and flexible ML workflow engineβ421Updated last year
- Plugin for deploying MLflow models to TorchServeβ110Updated 2 years ago
- The repository that contains all source code for the ZenML UI.β48Updated this week
- A series of Terraform based recipes to provision popular MLOps stacks on the cloud.β255Updated 10 months ago
- Large Language Model Hosting Containerβ91Updated 3 weeks ago
- Get your MLOps (Level 1) platform started and going fast.β123Updated 2 years ago
- aim-mlflow integrationβ219Updated 2 years ago
- Ready to run docker-compose configuration for ML Flow with Mysql and Minio S3β258Updated last year
- This repository provides a curated list of references about Machine Learning Model Governance, Ethics, and Responsible AI.β116Updated last year
- Article about deploying machine learning models using grpc, pytorch and asyncioβ29Updated 2 years ago
- Machine Learning eXchange (MLX). Data and AI Assets Catalog and Execution Engineβ214Updated last month
- In this project I played with mlflow, streamlit and fastapi to create a training and prediction app on digitsβ107Updated 3 years ago
- πΉοΈ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.β137Updated last year
- A MLOps platform using prefect, mlflow, FastAPI, Prometheus/Grafana und streamlitβ87Updated 2 years ago