bentoml / YataiLinks
Model Deployment at Scale on Kubernetes 🦄️
☆826Updated last year
Alternatives and similar repositories for Yatai
Users that are interested in Yatai are comparing it to the libraries listed below
Sorting:
- An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more☆854Updated 3 weeks ago
- A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine☆882Updated last week
- ☆703Updated 3 years ago
- 🏕️ Reproducible development environment for humans and agents☆2,157Updated this week
- Hopsworks - Data-Intensive AI platform with a Feature Store☆1,258Updated 9 months ago
- Kubeflow’s superfood for Data Scientists☆641Updated this week
- Docker for Your ML/DL Models Based on OCI Artifacts☆473Updated last year
- User documentation for KServe.☆109Updated this week
- MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integra…☆1,610Updated this week
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆275Updated 2 years ago
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆674Updated last year
- UnionML: the easiest way to build and deploy machine learning microservices☆336Updated 2 years ago
- A toolkit to run Ray applications on Kubernetes☆2,121Updated last week
- Controller for ModelMesh☆239Updated 5 months ago
- Compare MLOps Platforms. Breakdowns of SageMaker, VertexAI, AzureML, Dataiku, Databricks, h2o, kubeflow, mlflow...☆394Updated 3 years ago
- 🎲 A curated list of MLOps projects, tools and resources☆185Updated last year
- A lightweight tool to get an AI Infrastructure Stack up in minutes not days. K3ai will take care of setup K8s for You, deploy the AI tool…☆124Updated 3 years ago
- ClearML - Model-Serving Orchestration and Repository Solution☆157Updated this week
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.☆204Updated 3 years ago
- 🍫 Example code for a basic ML Platform based on Pulumi, FastAPI, DVC, MLFlow and more☆444Updated 4 years ago
- dstack is an open-source control plane for running development, training, and inference jobs on GPUs—across hyperscalers, neoclouds, or o…☆1,952Updated this week
- Fast model deployment on any cloud 🚀☆175Updated last year
- GPU environment and cluster management with LLM support☆652Updated last year
- 🐶 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🤞☆719Updated 2 years ago
- The simplest way to serve AI/ML models in production☆1,083Updated this week
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆4,746Updated this week
- Distributed Model Serving Framework☆178Updated last month
- A Python vector database you just need - no more, no less.☆632Updated last year
- 🏬 modelstore is a Python library that allows you to version, export, and save a machine learning model to your filesystem or a cloud sto…☆398Updated 9 months ago
- ML pipeline orchestration and model deployments on Kubernetes.☆433Updated 2 years ago