project-codeflare / zero-copy-model-loading

Related projects ⓘ

Alternatives and complementary repositories for zero-copy-model-loading

• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆20Updated 6 months ago
• hora-search / horapy
  🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library
  ☆68Updated 3 years ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆146Updated 2 weeks ago
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆66Updated 10 months ago
• ray-project / pygloo
  Pygloo provides Python bindings for Gloo.
  ☆16Updated 3 weeks ago
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆98Updated 2 months ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆153Updated this week
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆107Updated last year
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆25Updated last week
• octoml / triton-client-rs
  A client library in Rust for Nvidia Triton.
  ☆24Updated last year
• nod-ai / SRT
  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …
  ☆107Updated this week
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆42Updated 2 years ago
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆14Updated last year
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆127Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆132Updated this week
• rapidsai / ucx-py
  Python bindings for UCX
  ☆121Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆188Updated last month
• pytorch-labs / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆103Updated this week
• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• mithril-security / tokenizers-wasm
  wasm bindings for huggingface tokenizers library
  ☆36Updated 2 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆116Updated 3 months ago
• facebookresearch / FAMBench
  Benchmarks to capture important workloads.
  ☆28Updated 5 months ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆175Updated last week
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆106Updated last year
• bentoml / IF-multi-GPUs-demo
  ☆12Updated last year
• Narsil / bloomserver
  ☆36Updated 2 years ago
• Lightning-Universe / Training-Studio_app
  Lightning HPO & Training Studio App
  ☆18Updated last year
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆43Updated 4 months ago