project-codeflare / zero-copy-model-loadingLinks
In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"
☆28Updated 3 years ago
Alternatives and similar repositories for zero-copy-model-loading
Users that are interested in zero-copy-model-loading are comparing it to the libraries listed below
Sorting:
- Module, Model, and Tensor Serialization/Deserialization☆270Updated 2 months ago
- Simple dependency injection framework for Python☆21Updated last year
- TorchFix - a linter for PyTorch-using code with autofix support☆149Updated 2 months ago
- Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`☆47Updated last year
- The Triton backend for the PyTorch TorchScript models.☆160Updated last week
- Unified storage framework for the entire machine learning lifecycle☆156Updated last year
- FIL backend for the Triton Inference Server☆83Updated 2 weeks ago
- Provide Python access to the NVML library for GPU diagnostics☆249Updated last month
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆161Updated last month
- 🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library☆73Updated 4 years ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆395Updated last week
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆181Updated last month
- Distributed skorch on Ray Train☆58Updated 3 years ago
- Awesome utilities for performance profiling☆195Updated 7 months ago
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆301Updated 2 weeks ago
- Distributed XGBoost on Ray☆150Updated last year
- The Triton backend for the ONNX Runtime.☆162Updated 2 weeks ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
- High-performance safetensors model loader☆67Updated this week
- Python bindings for UCX☆140Updated last month
- Python package to generate image embeddings with CLIP without PyTorch/TensorFlow☆153Updated 3 years ago
- Plugin for deploying MLflow models to TorchServe☆110Updated 2 years ago
- ⚡ A fast embedded library for approximate nearest neighbor search☆234Updated 2 years ago
- ☆14Updated 3 years ago
- A collection of reproducible inference engine benchmarks☆34Updated 6 months ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆213Updated 6 months ago
- A top-like tool for monitoring GPUs in a cluster☆85Updated last year
- Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …☆106Updated 9 months ago
- ☆37Updated this week
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆199Updated this week