awesome-mlops / awesome-ml-servingLinks
A curated list of awesome open source and commercial platforms for serving models in production 🚀
☆47Updated 3 years ago
Alternatives and similar repositories for awesome-ml-serving
Users that are interested in awesome-ml-serving are comparing it to the libraries listed below
Sorting:
- ClearML - Model-Serving Orchestration and Repository Solution☆161Updated last month
- Get started DVC project☆65Updated last year
- This project shows how to serve an ONNX-optimized image classification model as a web service with FastAPI, Docker, and Kubernetes.☆224Updated 3 years ago
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆88Updated 2 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated 2 years ago
- BentoML Example Projects 🎨☆142Updated last year
- Self-host LLMs with vLLM and BentoML☆168Updated 3 weeks ago
- Fine-tune an LLM to perform batch inference and online serving.☆120Updated 8 months ago
- ☆67Updated 10 months ago
- Dataset registry DVC project☆85Updated last year
- 🎲 A curated list of MLOps projects, tools and resources☆187Updated last year
- ☆32Updated 3 years ago
- Examples of using Evidently to evaluate, test and monitor ML models.☆48Updated last month
- Repository for open inference protocol specification☆64Updated 9 months ago
- This repository provides a curated list of references about Machine Learning Model Governance, Ethics, and Responsible AI.☆123Updated last year
- Chassis turns machine learning models into portable container images that can run just about anywhere.☆86Updated last year
- Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo☆490Updated last month
- Machine Learning eXchange (MLX). Data and AI Assets Catalog and Execution Engine☆216Updated 4 months ago
- End to End example integrating MLFlow and Seldon Core☆51Updated 5 years ago
- A repository that showcases how you can use ZenML with Git☆74Updated 3 weeks ago
- Solutions provided to Chip Huyen's Machine Learning Interview Book with GPT☆43Updated 2 years ago
- A series of Terraform based recipes to provision popular MLOps stacks on the cloud.☆256Updated last year
- A repository for all ZenML projects that are specific production use-cases.☆303Updated 2 months ago
- Article about deploying machine learning models using grpc, pytorch and asyncio☆30Updated 3 years ago
- A collection of all available inference solutions for the LLMs☆94Updated 11 months ago
- A top-like tool for monitoring GPUs in a cluster☆84Updated last year
- GPT2 fine-tuning pipeline with KerasNLP, TensorFlow, and TensorFlow Extended☆33Updated 2 years ago
- A repository providing demo code for deploying a lightweight Scikit-Learn based ML pipeline modelling heart disease data as a Google Clou…☆10Updated last year
- ☁️ Terraform plugin for machine learning workloads: spot instance recovery & auto-termination | AWS, GCP, Azure, Kubernetes☆294Updated last year
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆86Updated last year