Alternatives and similar repositories for torchgpipe

Users that are interested in torchgpipe are comparing it to the libraries listed below

• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆509Updated 4 years ago
• snuspl / nimble
  Lightweight and Parallel Deep Learning Framework
  ☆263Updated 3 years ago
• msr-fiddle / pipedream
  ☆392Updated 3 years ago
• awwong1 / torchprof
  PyTorch layer-by-layer model profiler
  ☆607Updated 4 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆300Updated 6 months ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,076Updated 3 months ago
• pytorch / kineto
  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
  ☆911Updated this week
• pytorch / elastic
  PyTorch elastic training
  ☆728Updated 3 years ago
• pytorch / benchmark
  TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
  ☆1,003Updated this week
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆632Updated 4 months ago
• chrischoy / pytorch-custom-cuda-tutorial
  Tutorial for building a custom CUDA function for Pytorch
  ☆521Updated 6 years ago
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆783Updated last year
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆366Updated 7 years ago
• Santosh-Gupta / SpeedTorch
  Library for faster pinned CPU <-> GPU transfer in Pytorch
  ☆683Updated 5 years ago
• openai / blocksparse
  Efficient GPU kernels for block-sparse matrix multiplication and convolution
  ☆1,063Updated 2 years ago
• seba-1511 / dist_tuto.pth
  Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial
  ☆266Updated 3 years ago
• pytorch / tvm
  TVM integration into PyTorch
  ☆456Updated 5 years ago
• pytorch / FBGEMM
  FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
  ☆1,510Updated this week
• pytorch / tensorpipe
  A tensor-aware point-to-point communication primitive for machine learning
  ☆280Updated last week
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆550Updated 4 years ago
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆336Updated last year
• pytorch / torchdynamo
  A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
  ☆1,070Updated last year
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆160Updated 4 years ago
• pytorch / gloo
  Collective communications library with various primitives for multi-machine training.
  ☆1,381Updated 3 weeks ago
• jiazhihao / TASO
  The Tensor Algebra SuperOptimizer for Deep Learning
  ☆731Updated 2 years ago
• pytorch / extension-cpp
  C++ extensions in PyTorch
  ☆1,171Updated 5 months ago
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,392Updated 8 months ago
• BaguaSys / bagua
  Bagua Speeds up PyTorch
  ☆881Updated last year
• microsoft / Tutel
  Tutel MoE: Optimized Mixture-of-Experts Library, Support GptOss/DeepSeek/Kimi-K2/Qwen3 using FP8/NVFP4/MXFP4
  ☆951Updated this week
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆449Updated last week