awesome-mlops / awesome-ml-servingLinks
A curated list of awesome open source and commercial platforms for serving models in production 🚀
☆46Updated 3 years ago
Alternatives and similar repositories for awesome-ml-serving
Users that are interested in awesome-ml-serving are comparing it to the libraries listed below
Sorting:
- This project shows how to serve an ONNX-optimized image classification model as a web service with FastAPI, Docker, and Kubernetes.☆221Updated 3 years ago
- ClearML - Model-Serving Orchestration and Repository Solution☆159Updated last month
- BentoML Example Projects 🎨☆141Updated 11 months ago
- 🎲 A curated list of MLOps projects, tools and resources☆186Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆115Updated 6 months ago
- Dataset registry DVC project☆85Updated last year
- Large Language Model Hosting Container☆90Updated 2 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Get started DVC project☆64Updated last year
- Self-host LLMs with vLLM and BentoML☆162Updated last month
- Source of the FSDL 2022 labs, which are at https://github.com/full-stack-deep-learning/fsdl-text-recognizer-2022-labs☆83Updated last year
- Chassis turns machine learning models into portable container images that can run just about anywhere.☆86Updated last year
- Deploying PyTorch Model to Production with FastAPI in CUDA-supported Docker☆105Updated 4 years ago
- A series of Terraform based recipes to provision popular MLOps stacks on the cloud.☆255Updated last year
- Serving large ml models independently and asynchronously via message queue and kv-storage for communication with other services [EXPERIME…☆16Updated 4 years ago
- A repository that showcases how you can use ZenML with Git☆73Updated 4 months ago
- Learn how to create reliable ML systems by testing code, data and models.☆89Updated 3 years ago
- ML/DL Math and Method notes☆65Updated 2 years ago
- Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo☆482Updated 3 months ago
- ☆32Updated 2 years ago
- This repository provides a curated list of references about Machine Learning Model Governance, Ethics, and Responsible AI.☆119Updated last year
- A collection of examples demonstrating how to use dstack☆26Updated last year
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆85Updated last year
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆88Updated last month
- MLOps Cookiecutter Template: A Base Project Structure for Secure Production ML Engineering☆42Updated last year
- Working example for serving a ML model using FastAPI and Celery☆74Updated 4 years ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)☆223Updated last month
- MLOps tutorial using Python, Docker and Kubernetes.☆407Updated last year
- End to End example integrating MLFlow and Seldon Core☆52Updated 5 years ago