Alternatives and similar repositories for torchgpipe:

Users that are interested in torchgpipe are comparing it to the libraries listed below

• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆505Updated 3 years ago
• msr-fiddle / pipedream
  ☆389Updated 2 years ago
• snuspl / nimble
  Lightweight and Parallel Deep Learning Framework
  ☆264Updated 2 years ago
• pytorch / kineto
  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
  ☆780Updated this week
• pytorch / elastic
  PyTorch elastic training
  ☆730Updated 2 years ago
• chrischoy / pytorch-custom-cuda-tutorial
  Tutorial for building a custom CUDA function for Pytorch
  ☆512Updated 6 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆366Updated 6 years ago
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆757Updated 6 months ago
• awwong1 / torchprof
  PyTorch layer-by-layer model profiler
  ☆606Updated 3 years ago
• pytorch / FBGEMM
  FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
  ☆1,274Updated this week
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆472Updated 3 years ago
• pytorch / torchdynamo
  A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
  ☆1,035Updated 11 months ago
• pytorch / tensorpipe
  A tensor-aware point-to-point communication primitive for machine learning
  ☆255Updated 2 years ago
• pytorch / tvm
  TVM integration into PyTorch
  ☆452Updated 5 years ago
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆601Updated 10 months ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆372Updated 4 years ago
• jiazhihao / TASO
  The Tensor Algebra SuperOptimizer for Deep Learning
  ☆704Updated 2 years ago
• seba-1511 / dist_tuto.pth
  Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial
  ☆260Updated 2 years ago
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆685Updated 5 years ago
• facebookincubator / gloo
  Collective communications library with various primitives for multi-machine training.
  ☆1,277Updated this week
• microsoft / Tutel
  Tutel MoE: An Optimized Mixture-of-Experts Implementation
  ☆784Updated this week
• microsoft / varuna
  ☆247Updated 7 months ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆546Updated 4 years ago
• openai / blocksparse
  Efficient GPU kernels for block-sparse matrix multiplication and convolution
  ☆1,039Updated last year
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆342Updated 5 years ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,049Updated 7 months ago
• AlibabaPAI / DAPPLE
  An Efficient Pipelined Data Parallel Approach for Training Large Model
  ☆74Updated 4 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆260Updated 2 years ago
• microsoft / nnfusion
  A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.
  ☆979Updated 6 months ago