bentoml / simple_diLinks
Simple dependency injection framework for Python
☆21Updated last year
Alternatives and similar repositories for simple_di
Users that are interested in simple_di are comparing it to the libraries listed below
Sorting:
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- Sentence Embedding as a Service☆15Updated 7 months ago
- ☆31Updated 9 months ago
- A minimal shared memory object store design☆59Updated 9 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 5 years ago
- A collection of reproducible inference engine benchmarks☆38Updated 9 months ago
- ☆44Updated this week
- Cortex-compatible model server for Python and TensorFlow☆18Updated 3 years ago
- MLOps Python Library☆121Updated 3 years ago
- Distributed XGBoost on Ray☆152Updated last year
- 🚀 Launching Bento in a Kubernetes cluster☆17Updated 10 months ago
- The Triton backend for the PyTorch TorchScript models.☆172Updated 2 weeks ago
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 3 years ago
- Python client for RedisAI☆89Updated 2 years ago
- ☆14Updated 3 years ago
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆81Updated last year
- This repository contains statistics about the AI Infrastructure products.☆17Updated 11 months ago
- The Triton backend for the ONNX Runtime.☆172Updated 2 weeks ago
- Ray provider for Apache Airflow☆47Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆279Updated 2 years ago
- 🎯 aimrocks 🎸 — python & cython bindings for RocksDB. Batteries included! 🔋☆33Updated last month
- ☆27Updated 2 years ago
- A small utility module to make it simple to build BentoML Services into images inside Kubernetes clusters.☆10Updated 5 years ago
- Module, Model, and Tensor Serialization/Deserialization☆286Updated 5 months ago
- In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"☆28Updated 3 years ago
- Distributed ML Optimizer☆35Updated 4 years ago
- A top-like tool for monitoring GPUs in a cluster☆84Updated last year
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆216Updated this week