bentoml / BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
☆7,669Updated this week
Alternatives and similar repositories for BentoML:
Users that are interested in BentoML are comparing it to the libraries listed below
- Open source platform for the machine learning lifecycle☆20,362Updated this week
- Build, Manage and Deploy AI/ML Systems☆8,766Updated this week
- The Open Source Feature Store for AI/ML☆6,031Updated this week
- An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models☆4,511Updated last week
- ♾️ CML - Continuous Machine Learning | CI/CD for ML☆4,096Updated last week
- Serve, optimize and scale PyTorch models in production☆4,315Updated last week
- Containers for machine learning☆8,572Updated this week
- 🦉 Data Versioning and ML Experiments☆14,417Updated this week
- Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.☆5,543Updated this week
- ZenML 🙏: The bridge between ML and Ops. https://zenml.io.☆4,565Updated this week
- Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stre…☆8,584Updated last week
- Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.☆6,197Updated this week
- Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. Fro…☆6,116Updated this week
- Standardized Serverless ML Inference Platform on Kubernetes☆4,130Updated this week
- Parallel computing with task scheduling☆13,163Updated this week
- AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file convert…☆20,506Updated this week
- ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling …☆5,967Updated this week
- Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets☆4,474Updated last week
- 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production☆9,646Updated 2 weeks ago
- A system for quickly generating training data with weak supervision☆5,854Updated last year
- A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.☆4,117Updated last week
- Hummingbird compiles trained ML models into tensor computation for faster inference.☆3,438Updated 2 weeks ago
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆8,673Updated this week
- A curated list of awesome MLOps tools☆4,470Updated 5 months ago
- 💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows☆10,843Updated last week
- SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability v…☆7,981Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆9,157Updated this week
- Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and…☆10,296Updated last week
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆13,222Updated this week
- Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, …☆3,139Updated last month