Alternatives and similar repositories for zero-copy-model-loading

Users that are interested in zero-copy-model-loading are comparing it to the libraries listed below

• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆21Updated last year
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆272Updated 2 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆164Updated this week
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆114Updated 2 years ago
• hora-search / horapy
  🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library
  ☆73Updated 4 years ago
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆83Updated this week
• gpuopenanalytics / pynvml
  Provide Python access to the NVML library for GPU diagnostics
  ☆249Updated 2 months ago
• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆399Updated last week
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆161Updated last month
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆181Updated 2 months ago
• serega / gaoya
  Locality Sensitive Hashing
  ☆74Updated 2 years ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆213Updated 6 months ago
• meta-pytorch / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆148Updated 2 months ago
• RedisAI / redisai-py
  Python client for RedisAI
  ☆88Updated 2 years ago
• microsoft / batch-inference
  Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.
  ☆102Updated last year
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆166Updated this week
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆37Updated 6 months ago
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆152Updated last year
• foundation-model-stack / fastsafetensors
  High-performance safetensors model loader
  ☆71Updated this week
• nicolargo / nvidia-ml-py3
  Python 3 Bindings for the NVIDIA Management Library
  ☆141Updated last year
• simon-mo / vLLM-Benchmark
  ☆31Updated 6 months ago
• google / space
  Unified storage framework for the entire machine learning lifecycle
  ☆155Updated last year
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆66Updated last year
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆106Updated 2 years ago
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆306Updated 2 weeks ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆64Updated last year
• rapidsai / ucx-py
  Python bindings for UCX
  ☆140Updated last month
• haixuanTao / bert-onnx-rs-server
  A Demo server serving Bert through ONNX with GPU written in Rust with <3
  ☆41Updated 4 years ago
• Quantco / spox
  Pythonic framework for building ONNX graphs
  ☆89Updated last week
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆103Updated last year