bentoml / simple_diLinks
Simple dependency injection framework for Python
☆21Updated last year
Alternatives and similar repositories for simple_di
Users that are interested in simple_di are comparing it to the libraries listed below
Sorting:
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- xet client tech, used in huggingface_hub☆127Updated this week
- ☆38Updated this week
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- A collection of reproducible inference engine benchmarks☆32Updated 2 months ago
- In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"☆28Updated 2 years ago
- Sentence Embedding as a Service☆15Updated 2 weeks ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- Distributed XGBoost on Ray☆149Updated last year
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆26Updated 3 months ago
- A minimal shared memory object store design☆53Updated 8 years ago
- Checkpoint the state of Python programs using Pythonic setjmp and longjmp☆67Updated 4 years ago
- Backend server for envd☆21Updated last year
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- 🏆 The winner code for Neurips'23 BigANN Competition OOD and Sparse track.☆12Updated last month
- ☆24Updated last year
- ☆29Updated 3 months ago
- Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …☆106Updated 6 months ago
- OpenDAL fsspec integration☆30Updated last month
- The Triton backend for the PyTorch TorchScript models.☆156Updated last week
- Cortex-compatible model server for Python and TensorFlow☆17Updated 2 years ago
- PostgreSQL tokenizer extension for full-text search☆15Updated last month
- This repository contains statistics about the AI Infrastructure products.☆18Updated 4 months ago
- High-performance safetensors model loader☆48Updated 2 weeks ago
- Simple high-throughput inference library☆120Updated 2 months ago
- Proof of concept on how to use TensorFlow for prediction tasks in a multiprocess setting.☆18Updated 6 years ago
- Distributed ML Optimizer☆32Updated 3 years ago
- No-GIL Python environment featuring NVIDIA Deep Learning libraries.☆62Updated 3 months ago
- HSNW module for Redis☆57Updated 4 years ago
- Python 3 Bindings for the NVIDIA Management Library☆139Updated last year