kakaobrain / torchgpipeLinks
A GPipe implementation in PyTorch
☆849Updated last year
Alternatives and similar repositories for torchgpipe
Users that are interested in torchgpipe are comparing it to the libraries listed below
Sorting:
- A GPU performance profiling tool for PyTorch models☆504Updated 4 years ago
- Lightweight and Parallel Deep Learning Framework☆264Updated 2 years ago
- ☆393Updated 2 years ago
- Slicing a PyTorch Tensor Into Parallel Shards☆300Updated 2 months ago
- PyTorch elastic training☆729Updated 3 years ago
- PyTorch layer-by-layer model profiler☆606Updated 4 years ago
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆976Updated this week
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆851Updated this week
- Profiling and inspecting memory in pytorch☆1,065Updated last year
- Experimental ground for optimizing memory of pytorch models☆366Updated 7 years ago
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆685Updated 5 years ago
- Tutorial for building a custom CUDA function for Pytorch☆520Updated 6 years ago
- Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial☆263Updated 2 years ago
- A general and accurate MACs / FLOPs profiler for PyTorch models☆626Updated 3 weeks ago
- Pipeline Parallelism for PyTorch☆775Updated last year
- Fast Block Sparse Matrices for Pytorch☆549Updated 4 years ago
- A tensor-aware point-to-point communication primitive for machine learning☆262Updated last week
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,428Updated this week
- Efficient GPU kernels for block-sparse matrix multiplication and convolution☆1,045Updated 2 years ago
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,059Updated last year
- TVM integration into PyTorch☆453Updated 5 years ago
- The Tensor Algebra SuperOptimizer for Deep Learning☆730Updated 2 years ago
- Collective communications library with various primitives for multi-machine training.☆1,344Updated this week
- A LARS implementation in PyTorch☆349Updated 5 years ago
- Block-sparse primitives for PyTorch☆158Updated 4 years ago
- Tutel MoE: Optimized Mixture-of-Experts Library, Support GptOss/DeepSeek/Kimi-K2/Qwen3 FP8/NVFP4/MXFP4☆896Updated 2 weeks ago
- Implementation of https://arxiv.org/abs/1904.00962☆376Updated 4 years ago
- Bagua Speeds up PyTorch☆884Updated last year
- C++ extensions in PyTorch☆1,140Updated last month
- A library to analyze PyTorch traces.☆404Updated last week