bentoml / BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
☆7,161Updated this week
Related projects ⓘ
Alternatives and complementary repositories for BentoML
- Open source platform for the machine learning lifecycle☆18,812Updated this week
- ♾️ CML - Continuous Machine Learning | CI/CD for ML☆4,039Updated this week
- ZenML 🙏: The bridge between ML and Ops. https://zenml.io.☆4,073Updated this week
- An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models☆4,386Updated this week
- The Open Source Feature Store for Machine Learning☆5,613Updated this week
- Serve, optimize and scale PyTorch models in production☆4,218Updated 3 weeks ago
- Hummingbird compiles trained ML models into tensor computation for faster inference.☆3,356Updated this week
- Open Source Platform for developing, scaling and deploying serious ML, AI, and data science systems☆8,256Updated this week
- 🦉 Data Versioning and ML Experiments☆13,927Updated this week
- Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.☆5,226Updated this week
- Production infrastructure for machine learning at scale☆8,021Updated 5 months ago
- TFX is an end-to-end platform for deploying production ML pipelines☆2,114Updated this week
- Low-code framework for building custom LLMs, neural networks, and other AI models☆11,192Updated this week
- Standardized Serverless ML Inference Platform on Kubernetes☆3,641Updated this week
- ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling …☆5,693Updated this week
- Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stre…☆8,181Updated this week
- MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integra…☆1,446Updated this week
- 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows☆9,375Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,016Updated this week
- Fit interpretable models. Explain blackbox machine learning.☆6,297Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆8,348Updated this week
- cuDF - GPU DataFrame Library☆8,451Updated this week
- A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.☆3,926Updated this week
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆11,533Updated this week
- Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. Fro…☆5,405Updated this week
- Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets☆3,986Updated this week
- 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production☆9,052Updated this week
- Machine Learning Toolkit for Kubernetes☆14,399Updated this week
- A curated list of awesome MLOps tools☆4,125Updated last month
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,299Updated last month