Alternatives and similar repositories for zero-copy-model-loading

Users that are interested in zero-copy-model-loading are comparing it to the libraries listed below

• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆270Updated 2 months ago
• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆21Updated last year
• meta-pytorch / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆149Updated 2 months ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆47Updated last year
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆160Updated last week
• google / space
  Unified storage framework for the entire machine learning lifecycle
  ☆156Updated last year
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆83Updated 2 weeks ago
• gpuopenanalytics / pynvml
  Provide Python access to the NVML library for GPU diagnostics
  ☆249Updated last month
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆161Updated last month
• hora-search / horapy
  🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library
  ☆73Updated 4 years ago
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆395Updated last week
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆181Updated last month
• Yard1 / ray-skorch
  Distributed skorch on Ray Train
  ☆58Updated 3 years ago
• msaroufim / awesome-profiling
  Awesome utilities for performance profiling
  ☆195Updated 7 months ago
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆301Updated 2 weeks ago
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆150Updated last year
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆162Updated 2 weeks ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆17Updated 3 years ago
• foundation-model-stack / fastsafetensors
  High-performance safetensors model loader
  ☆67Updated this week
• rapidsai / ucx-py
  Python bindings for UCX
  ☆140Updated last month
• minimaxir / imgbeddings
  Python package to generate image embeddings with CLIP without PyTorch/TensorFlow
  ☆153Updated 3 years ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆110Updated 2 years ago
• jina-ai / annlite
  ⚡ A fast embedded library for approximate nearest neighbor search
  ☆234Updated 2 years ago
• msaroufim / torchprep
  ☆14Updated 3 years ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆34Updated 6 months ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆213Updated 6 months ago
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆85Updated last year
• nod-ai / SRT
  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …
  ☆106Updated 9 months ago
• coreweave / ml-containers
  ☆37Updated this week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆199Updated this week