bentoml / Yatai
Model Deployment at Scale on Kubernetes π¦οΈ
β799Updated 10 months ago
Alternatives and similar repositories for Yatai:
Users that are interested in Yatai are comparing it to the libraries listed below
- An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and moreβ771Updated this week
- Fast model deployment on any cloud πβ176Updated last year
- β704Updated 2 years ago
- Docker for Your ML/DL Models Based on OCI Artifactsβ465Updated last year
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elasβ¦β648Updated 11 months ago
- Hopsworks - Data-Intensive AI platform with a Feature Storeβ1,213Updated last month
- Controller for ModelMeshβ225Updated 3 weeks ago
- User documentation for KServe.β104Updated this week
- π² A curated list of MLOps projects, tools and resourcesβ186Updated 10 months ago
- MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integraβ¦β1,503Updated this week
- Standardized Serverless ML Inference Platform on Kubernetesβ3,993Updated this week
- ML pipeline orchestration and model deployments on Kubernetes.β435Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)β260Updated last year
- A toolkit to run Ray applications on Kubernetesβ1,601Updated this week
- ποΈ Reproducible development environmentβ2,098Updated this week
- Kubeflowβs superfood for Data Scientistsβ632Updated 2 years ago
- Compare MLOps Platforms. Breakdowns of SageMaker, VertexAI, AzureML, Dataiku, Databricks, h2o, kubeflow, mlflow...β390Updated 2 years ago
- πΆ A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one dayπ€β718Updated last year
- A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)β204Updated 4 months ago
- CDF SIG MLOpsβ615Updated 3 months ago
- dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-premβ¦β1,732Updated this week
- ClearML - Model-Serving Orchestration and Repository Solutionβ146Updated 2 months ago
- A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machineβ830Updated this week
- A lightweight tool to get an AI Infrastructure Stack up in minutes not days. K3ai will take care of setup K8s for You, deploy the AI toolβ¦β125Updated 3 years ago
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.β1,865Updated this week
- π Launching Bento in a Kubernetes clusterβ17Updated this week
- A series of Terraform based recipes to provision popular MLOps stacks on the cloud.β254Updated 5 months ago
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.β195Updated 2 years ago
- Distributed Model Serving Frameworkβ159Updated last week
- Kubeflow Deployment Manifestsβ877Updated this week