Alternatives and similar repositories for zero-copy-model-loading:

Users that are interested in zero-copy-model-loading are comparing it to the libraries listed below

• coreweave / ml-containers
  ☆30Updated last week
• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆20Updated 10 months ago
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆44Updated 2 years ago
• ray-project / pygloo
  Pygloo provides Python bindings for Gloo.
  ☆21Updated 3 weeks ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆108Updated last year
• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆67Updated last year
• gpuopenanalytics / pynvml
  Provide Python access to the NVML library for GPU diagnostics
  ☆226Updated 3 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆217Updated last month
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆65Updated last year
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆144Updated last week
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 7 months ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆155Updated 3 months ago
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆86Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• bentoml / IF-multi-GPUs-demo
  ☆12Updated last year
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year
• machinable-org / machinable
  A modular system for machinable research code
  ☆35Updated 2 months ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆108Updated last year
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated 2 years ago
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆52Updated last month
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆140Updated last week
• octoml / triton-client-rs
  A client library in Rust for Nvidia Triton.
  ☆28Updated last year
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆61Updated 9 months ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 5 months ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆44Updated 9 months ago
• mlcommons / mlcube
  MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.
  ☆154Updated 6 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated 8 months ago
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆109Updated 3 weeks ago
• srush / g9py
  ☆18Updated last year