Model Deployment at Scale on Kubernetes 🦄️
☆836May 8, 2024Updated last year
Alternatives and similar repositories for Yatai
Users that are interested in Yatai are comparing it to the libraries listed below
Sorting:
- Fast model deployment on any cloud 🚀☆176Feb 25, 2024Updated 2 years ago
- The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!☆8,487Updated this week
- 🚀 Launching Bento in a Kubernetes cluster☆17Mar 16, 2025Updated 11 months ago
- An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models☆4,731Updated this week
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes☆5,162Updated this week
- Sentence Embedding as a Service☆15Jun 30, 2025Updated 8 months ago
- 🏕️ Reproducible development environment for humans and agents☆2,188Updated this week
- Simple dependency injection framework for Python☆21May 15, 2024Updated last year
- ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.☆5,245Updated this week
- A small utility module to make it simple to build BentoML Services into images inside Kubernetes clusters.☆10Dec 15, 2020Updated 5 years ago
- An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more☆876Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,148Updated this week
- The Open Source Feature Store for AI/ML☆6,756Updated this week
- BentoML Example Projects 🎨☆142Jan 6, 2025Updated last year
- A bridge between different serde implementations.☆16Sep 8, 2025Updated 5 months ago
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, o…☆9,516Updated this week
- A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine☆892Updated this week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,767Updated this week
- Automated Machine Learning on Kubernetes☆1,660Feb 28, 2026Updated last week
- ML pipeline orchestration and model deployments on Kubernetes.☆435Aug 18, 2023Updated 2 years ago
- Data Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.☆9,174Updated this week
- Build, Manage and Deploy AI/ML Systems☆9,903Updated this week
- Machine Learning Toolkit for Kubernetes☆15,482Jan 5, 2026Updated 2 months ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆281Nov 3, 2023Updated 2 years ago
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,967Jul 3, 2025Updated 8 months ago
- The open source developer platform to build AI agents and models with confidence. Enhance your AI applications with end-to-end tracking, …☆24,485Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,406Updated this week
- ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling …☆6,548Feb 28, 2026Updated last week
- Yet another virtualization runtime, make Virtual Machine greate again!☆28Jan 20, 2026Updated last month
- An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model perf…☆2,800Jan 10, 2025Updated last year
- An embeddable graph database for large-scale vertices and edges☆74Apr 16, 2023Updated 2 years ago
- A must-have configuration for Spacemacs users after defecting to Vim☆296Aug 15, 2025Updated 6 months ago
- 🐳 Build OCI images for Bentos in k8s☆20Updated this week
- Docker for Your ML/DL Models Based on OCI Artifacts☆474Jan 26, 2024Updated 2 years ago
- Event streaming platform for agents, apps, and analytics. Continuously ingest, transform, and serve event data in real time, at scale.☆8,839Updated this week
- MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integra…☆1,655Updated this week
- Apache OpenDAL: One Layer, All Storage.☆4,923Updated this week
- 🦉 Data Versioning and ML Experiments☆15,404Feb 27, 2026Updated last week
- 🐶 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🤞☆718Sep 13, 2023Updated 2 years ago