bentoml / simple_di
Simple dependency injection framework for Python
☆20Updated 10 months ago
Alternatives and similar repositories for simple_di:
Users that are interested in simple_di are comparing it to the libraries listed below
- MLFlow Deployment Plugin for Ray Serve☆44Updated 2 years ago
- Sentence Embedding as a Service☆15Updated last year
- Cortex-compatible model server for Python and TensorFlow☆17Updated 2 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated last year
- ☆12Updated last year
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- 🚀 Launching Bento in a Kubernetes cluster☆17Updated this week
- 🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library☆72Updated 3 years ago
- ☆12Updated 3 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- Distributed ML Optimizer☆30Updated 3 years ago
- In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"☆26Updated 2 years ago
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- ☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.☆45Updated last week
- Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.☆78Updated 8 months ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated last month
- Notes and artifacts from the ONNX steering committee☆25Updated 2 weeks ago
- HSNW module for Redis☆57Updated 4 years ago
- A file utility for accessing both local and remote files through a unified interface.☆38Updated last week
- vLLM adapter for a TGIS-compatible gRPC server.☆23Updated this week
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…☆67Updated last year
- paper and code for New Directions in Cloud Programming, CIDR 2021☆11Updated 4 years ago
- ☆30Updated last week
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated last year
- Proof of concept on how to use TensorFlow for prediction tasks in a multiprocess setting.☆18Updated 5 years ago
- A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.☆103Updated 2 years ago
- ☆17Updated 9 months ago
- setup the env for vllm users☆16Updated last year
- Pygloo provides Python bindings for Gloo.☆21Updated 3 weeks ago