bentoml / simple_diLinks
Simple dependency injection framework for Python
☆21Updated last year
Alternatives and similar repositories for simple_di
Users that are interested in simple_di are comparing it to the libraries listed below
Sorting:
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- Sentence Embedding as a Service☆15Updated 4 months ago
- In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"☆28Updated 3 years ago
- ☆42Updated 2 weeks ago
- Cortex-compatible model server for Python and TensorFlow☆17Updated 2 years ago
- ☆31Updated 6 months ago
- A collection of reproducible inference engine benchmarks☆37Updated 6 months ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- The Triton backend for the PyTorch TorchScript models.☆164Updated this week
- ☆14Updated 3 years ago
- 🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library☆73Updated 4 years ago
- Python client for RedisAI☆88Updated 2 years ago
- xet client tech, used in huggingface_hub☆316Updated this week
- MLOps Python Library☆120Updated 3 years ago
- The Triton backend for the ONNX Runtime.☆166Updated this week
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆81Updated last year
- Jenkins job definitions for OSSCI☆10Updated 3 years ago
- Unified storage framework for the entire machine learning lifecycle☆155Updated last year
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- Module, Model, and Tensor Serialization/Deserialization☆272Updated 2 months ago
- Distributed XGBoost on Ray☆152Updated last year
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆37Updated last month
- A minimal shared memory object store design☆54Updated 9 years ago
- OpenDAL fsspec integration☆31Updated 5 months ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 8 months ago
- A small utility module to make it simple to build BentoML Services into images inside Kubernetes clusters.☆10Updated 4 years ago
- Ray provider for Apache Airflow☆47Updated last year
- Home for OctoML PyTorch Profiler☆114Updated 2 years ago