Alternatives and similar repositories for zero-copy-model-loading

Users that are interested in zero-copy-model-loading are comparing it to the libraries listed below

• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆21Updated last year
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆65Updated last year
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated 2 years ago
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated 2 years ago
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆45Updated 3 years ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆44Updated last year
• hora-search / horapy
  🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library
  ☆72Updated 3 years ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆96Updated 6 months ago
• ray-project / pygloo
  Pygloo provides Python bindings for Gloo.
  ☆22Updated 3 months ago
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆26Updated this week
• Narsil / bloomserver
  ☆39Updated 2 years ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆31Updated last month
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• nateraw / lambdacloud
  An unofficial Python client library for Lambda Lab's Cloud Computing Platform
  ☆12Updated 2 years ago
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆110Updated 3 weeks ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆61Updated 4 months ago
• mithril-security / tokenizers-wasm
  wasm bindings for huggingface tokenizers library
  ☆34Updated 2 years ago
• msaroufim / torchprep
  ☆13Updated 2 years ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆42Updated 3 weeks ago
• pytorch-labs / monarch
  PyTorch Single Controller
  ☆16Updated this week
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆67Updated last year
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated last year
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆234Updated last week
• coreweave / ml-containers
  ☆34Updated 2 weeks ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆109Updated 2 years ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆44Updated 10 months ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆28Updated 2 years ago
• foundation-model-stack / fastsafetensors
  High-performance safetensors model loader
  ☆36Updated this week