project-codeflare / zero-copy-model-loading

Related projects: ⓘ

• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆21Updated 4 months ago
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆66Updated 8 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆175Updated 3 weeks ago
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆43Updated 2 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆34Updated 2 months ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆56Updated last week
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆66Updated last year
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆105Updated last year
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated last month
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆145Updated this week
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆117Updated last week
• bentoml / IF-multi-GPUs-demo
  ☆12Updated last year
• mosaicml / yahp
  hyperparameter management
  ☆43Updated last year
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆41Updated 2 years ago
• ray-project / pygloo
  Pygloo provides Python bindings for Gloo.
  ☆16Updated 4 months ago
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆24Updated this week
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆144Updated this week
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆173Updated 3 months ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated 11 months ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• Shopify / torch-grammar
  ☆65Updated 2 months ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆106Updated last year
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆80Updated 7 months ago
• ray-project / distml
  Distributed ML Optimizer
  ☆31Updated 3 years ago
• bentoml / diffusers-examples
  API serving for your diffusers models
  ☆10Updated 8 months ago
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆94Updated this week
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA
  ☆48Updated this week
• octoml / triton-client-rs
  A client library in Rust for Nvidia Triton.
  ☆23Updated last year
• aredden / torch-cublas-hgemm
  PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
  ☆25Updated 3 weeks ago