Alternatives and similar repositories for zero-copy-model-loading

Users that are interested in zero-copy-model-loading are comparing it to the libraries listed below

• gpuopenanalytics / pynvml
  Provide Python access to the NVML library for GPU diagnostics
  ☆258Updated 4 months ago
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆87Updated this week
• meta-pytorch / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆152Updated 5 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆286Updated 5 months ago
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆328Updated last week
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆164Updated 3 weeks ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆182Updated last month
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆172Updated 2 weeks ago
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆411Updated last week
• rapidsai / ucx-py
  Python bindings for UCX
  ☆139Updated 4 months ago
• google / space
  Unified storage framework for the entire machine learning lifecycle
  ☆155Updated last year
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆152Updated last year
• microsoft / batch-inference
  Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.
  ☆106Updated last year
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆67Updated 2 years ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆216Updated this week
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆66Updated 2 years ago
• ray-project / ray_lightning
  Pytorch Lightning Distributed Accelerators using Ray
  ☆215Updated 2 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆117Updated last year
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆110Updated 2 years ago
• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆21Updated last year
• ray-project / distml
  Distributed ML Optimizer
  ☆35Updated 4 years ago
• nums-project / nums
  A library that translates Python and NumPy to optimized distributed systems code.
  ☆131Updated 3 years ago
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆130Updated last week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆172Updated 2 weeks ago
• nod-ai / SRT
  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …
  ☆107Updated last month
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆17Updated 3 years ago
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆78Updated 3 months ago
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆46Updated 3 years ago
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last month