bentoml / simple_diLinks
Simple dependency injection framework for Python
☆21Updated last year
Alternatives and similar repositories for simple_di
Users that are interested in simple_di are comparing it to the libraries listed below
Sorting:
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- Sentence Embedding as a Service☆15Updated 3 months ago
- Cortex-compatible model server for Python and TensorFlow☆17Updated 2 years ago
- ☆37Updated this week
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"☆28Updated 3 years ago
- ☆31Updated 6 months ago
- A collection of reproducible inference engine benchmarks☆34Updated 6 months ago
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- Blazing fast data loading with HuggingFace Dataset and Ray Data☆16Updated last year
- MLOps Python Library☆120Updated 3 years ago
- ☆14Updated 3 years ago
- Module, Model, and Tensor Serialization/Deserialization☆270Updated 2 months ago
- Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …☆106Updated 9 months ago
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆35Updated 2 weeks ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
- xet client tech, used in huggingface_hub☆302Updated this week
- 🚀 Launching Bento in a Kubernetes cluster☆17Updated 7 months ago
- Simple high-throughput inference library☆147Updated 5 months ago
- The Triton backend for the PyTorch TorchScript models.☆160Updated last week
- Python client for RedisAI☆88Updated 2 years ago
- Synchronicity lets you interoperate with asynchronous Python APIs.☆124Updated 2 months ago
- The Triton backend for the ONNX Runtime.☆162Updated 2 weeks ago
- Jenkins job definitions for OSSCI☆10Updated 3 years ago
- Checkpoint the state of Python programs using Pythonic setjmp and longjmp☆67Updated 4 years ago
- Unified storage framework for the entire machine learning lifecycle☆156Updated last year
- A minimal shared memory object store design☆54Updated 8 years ago
- PyTorch centric eager mode debugger☆48Updated 10 months ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 8 months ago