Alternatives and similar repositories for zero-copy-model-loading

Users that are interested in zero-copy-model-loading are comparing it to the libraries listed below

• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆21Updated last year
• ray-project / pygloo
  Pygloo provides Python bindings for Gloo.
  ☆22Updated 2 months ago
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆65Updated last year
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆229Updated this week
• philschmid / deep-learning-remote-runner
  ☆16Updated 2 years ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆30Updated 3 weeks ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 7 months ago
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆26Updated this week
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆44Updated 11 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆150Updated last week
• hora-search / horapy
  🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library
  ☆72Updated 3 years ago
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆67Updated last year
• foundation-model-stack / fms-acceleration
  🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
  ☆9Updated 2 weeks ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆157Updated 5 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated 10 months ago
• glami / glami-1m
  The largest multilingual image-text classification dataset. It contains fashion products.
  ☆72Updated last year
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆60Updated last month
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆262Updated this week
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆180Updated 5 months ago
• pytorch-labs / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆141Updated 3 months ago
• Stability-AI / stability-hpc
  Deploy your HPC Cluster on AWS in 20min. with just 1-Click.
  ☆55Updated last month
• foundation-model-stack / fastsafetensors
  High-performance safetensors model loader
  ☆30Updated last month
• bentoml / IF-multi-GPUs-demo
  ☆13Updated last year
• coreweave / ml-containers
  ☆32Updated this week
• gpuopenanalytics / pynvml
  Provide Python access to the NVML library for GPU diagnostics
  ☆235Updated 5 months ago
• run-ai / runai-model-streamer
  ☆207Updated last week
• huggingface / optimum-furiosa
  Accelerated inference of 🤗 models using FuriosaAI NPU chips.
  ☆26Updated 11 months ago
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆42Updated this week
• onnx / neural-compressor
  Model compression for ONNX
  ☆92Updated 6 months ago
• serega / gaoya
  Locality Sensitive Hashing
  ☆73Updated last year