Alternatives and similar repositories for awesome-ml-serving:

Users that are interested in awesome-ml-serving are comparing it to the libraries listed below

• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆87Updated this week
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆10Updated 9 months ago
• iterative / dataset-registry
  Dataset registry DVC project
  ☆74Updated 9 months ago
• EthicalML / sml-security
  MLOps Cookiecutter Template: A Base Project Structure for Secure Production ML Engineering
  ☆40Updated 3 months ago
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆43Updated 2 years ago
• evidentlyai / community-examples
  Examples of using Evidently to evaluate, test and monitor ML models.
  ☆20Updated this week
• dstackai / dstack-examples
  A collection of examples demonstrating how to use dstack
  ☆26Updated 8 months ago
• zenml-io / zenml-gitflow
  A repository that showcases how you can use ZenML with Git
  ☆69Updated 6 months ago
• chassisml / chassis
  Chassis turns machine learning models into portable container images that can run just about anywhere.
  ☆86Updated 9 months ago
• gasparian / ml-serving-template
  Serving large ml models independently and asynchronously via message queue and kv-storage for communication with other services [EXPERIME…
  ☆15Updated 3 years ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆101Updated 7 months ago
• aporia-ai / mlops.toys
  🎲 A curated list of MLOps projects, tools and resources
  ☆186Updated 9 months ago
• awesome-mlops / awesome-ml-experiment-management
  A curated list of awesome open source tools and commercial products for ML Experiment Tracking and Management 🚀
  ☆121Updated 7 months ago
• SeldonIO / tempo
  MLOps Python Library
  ☆117Updated 2 years ago
• substratusai / vllm-docker
  ☆53Updated last month
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆58Updated last year
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆108Updated last year
• zenml-io / zenml-dashboard
  The repository that contains all source code for the ZenML UI.
  ☆44Updated this week
• ertis-research / kafka-ml
  Kafka-ML: connecting the data stream with ML/AI frameworks (now TensorFlow and PyTorch!)
  ☆181Updated 4 months ago
• flyteorg / flytelab
  Machine Learning Projects with Flytekit
  ☆35Updated last year
• mlops-labs-team1 / engineering.labs
  The project completed for MLops Engineering Lab #1 by Team #1. See our wiki for more info
  ☆16Updated 3 years ago
• awesome-mlops / awesome-feature-store
  A curated list of awesome open source and commercial feature store tools and platforms 🚀
  ☆15Updated 2 years ago
• ai-infrastructure-alliance / blueprints
  ☆30Updated 2 years ago
• FrancescoSaverioZuppichini / dynamic-batching-asyncio
  ☆31Updated 2 years ago
• anyscale / Made-With-ML
  ☆27Updated last year
• bentoml / aws-lambda-deploy
  Fast model deployment on AWS Lambda
  ☆14Updated 11 months ago
• GokuMohandas / testing-ml
  Learn how to create reliable ML systems by testing code, data and models.
  ☆86Updated 2 years ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 2 months ago
• sayakpaul / ml-deployment-k8s-fastapi
  This project shows how to serve an ONNX-optimized image classification model as a web service with FastAPI, Docker, and Kubernetes.
  ☆207Updated 2 years ago