awesome-mlops / awesome-ml-serving
A curated list of awesome open source and commercial platforms for serving models in production π
β38Updated 3 years ago
Alternatives and similar repositories for awesome-ml-serving
Users that are interested in awesome-ml-serving are comparing it to the libraries listed below
Sorting:
- Dataset registry DVC projectβ74Updated last year
- Article about deploying machine learning models using grpc, pytorch and asyncioβ28Updated 2 years ago
- ClearML - Model-Serving Orchestration and Repository Solutionβ150Updated 4 months ago
- serving a torch model using Celery, Redis and RabbitMQ to serve users asynchronouslyβ21Updated last year
- Fast model deployment on AWS Lambdaβ14Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessβ¦β114Updated last year
- Fine-tune an LLM to perform batch inference and online serving.β110Updated last week
- A repository that showcases how you can use ZenML with Gitβ68Updated this week
- Examples of using Evidently to evaluate, test and monitor ML models.β23Updated this week
- A collection of examples demonstrating how to use dstackβ26Updated 11 months ago
- Learn how to create reliable ML systems by testing code, data and models.β86Updated 2 years ago
- β16Updated 2 years ago
- Self-host LLMs with vLLM and BentoMLβ109Updated this week
- Plugin for deploying MLflow models to TorchServeβ108Updated 2 years ago
- Get started DVC projectβ54Updated 10 months ago
- Metaflow tutorials for ODSC West 2021β64Updated 3 years ago
- β27Updated last year
- Cortex-compatible model server for Python and TensorFlowβ17Updated 2 years ago
- VS Code extension for create remote workstations (sessions) using ClearML.β16Updated last year
- Learn how to monitor ML systems to identify and mitigate sources of drift before model performance decay.β84Updated 2 years ago
- Deploy and Scale LLM-based applicationsβ26Updated last year
- π² A curated list of MLOps projects, tools and resourcesβ186Updated last year
- MLFlow Deployment Plugin for Ray Serveβ44Updated 3 years ago
- Machine Learning Serving focused on GenAI with simplicity as the top priority.β58Updated last month
- BentoML Example Projects π¨β138Updated 4 months ago
- β32Updated 2 years ago
- A framework for simulating e-commerce data and interactions that can be used to build recommendation systemsβ10Updated last year
- Example project with a complete MLOps cycle: versioning data, generating reports on pull requests and deploying the model on releases witβ¦β49Updated 3 years ago
- Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP productsβ96Updated last year
- MLOps Cookiecutter Template: A Base Project Structure for Secure Production ML Engineeringβ40Updated 6 months ago