The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
β8,943Nov 17, 2026Updated this week
Alternatives and similar repositories for BentoML
Users that are interested in BentoML are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An MLOps framework to package, deploy, monitor and manage thousands of production machine learning modelsβ4,781Mar 23, 2026Updated 7 months ago
- Model Deployment at Scale on Kubernetes π¦οΈβ839May 30, 2026Updated 5 months ago
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, aβ¦β28,899Updated this week
- The Open Source Feature Store for AI/MLβ7,362Updated this week
- ZenML π: One AI Platform from Pipelines to Agents. https://zenml.io.β5,635Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Build, Manage and Deploy AI/ML Systemsβ10,354Updated this week
- π¦ Data Versioning and ML Experimentsβ15,985Updated this week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.β44,340Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.β12,608Updated this week
- Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetesβ6,252Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.β11,156Updated this week
- Production infrastructure for machine learning at scaleβ8,005Jun 12, 2024Updated 2 years ago
- The Cloud Native AI Platformβ15,973Sep 30, 2026Updated last month
- Evidently is ββan open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. Froβ¦β8,075Sep 29, 2026Updated last month
- Virtual machines for every use case on DigitalOcean β’ AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learningβ21,120Nov 12, 2026Updated last week
- ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling β¦β6,943Nov 3, 2026Updated 2 weeks ago
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering andβ¦β11,057Updated this week
- Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s β in pure Python with async/await, alsoβ¦β7,814Updated this week
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.β24,192Updated this week
- Serve, optimize and scale PyTorch models in productionβ4,344Aug 6, 2025Updated last year
- Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.β31,467Updated this week
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and aβ¦β27,051Updated this week
- βΎοΈ CML - Continuous Machine Learning | CI/CD for MLβ4,194Oct 21, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- βοΈ Build multimodal AI applications with cloud-native stackβ21,851Mar 24, 2025Updated last year
- Streamlit β The agent-native framework for data apps and dashboards.β46,457Updated this week
- A curated list of references for MLOpsβ14,304Nov 21, 2024Updated last year
- Build and share delightful machine learning apps, all in Python. π Star to support our work!β44,093Updated this week
- Low-code framework for building custom LLMs, neural networks, and other AI modelsβ11,792Updated this week
- Aim π« β An easy-to-use & supercharged open-source experiment tracker.β6,297Nov 7, 2026Updated 2 weeks ago
- The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build cuβ¦β10,862Updated this week
- Always know what to expect from your data.β11,942Updated this week
- Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and trainβ¦β9,271May 21, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Modin: Scale your Pandas workflows by changing a single line of codeβ10,389Feb 10, 2026Updated 9 months ago
- AI Infra / AI Orchestration / AI Control Planeβ3,747Updated this week
- An orchestration platform for the development, production, and observation of data assets.β16,447Updated this week
- Milvus is a high-performance, cloud-native vector database built for scalable vector ANN searchβ46,707Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.β43,347Updated this week
- LlamaIndex is the document processing platform for AIβ52,967Updated this week
- An open-source data logging library for machine learning models and data pipelines. π Provides visibility into data quality & model perfβ¦β2,839Jan 10, 2025Updated last year
Are these results useful?