kakaobrain / torchgpipeLinks
A GPipe implementation in PyTorch
☆842Updated 10 months ago
Alternatives and similar repositories for torchgpipe
Users that are interested in torchgpipe are comparing it to the libraries listed below
Sorting:
- ☆390Updated 2 years ago
- A GPU performance profiling tool for PyTorch models☆503Updated 3 years ago
- Lightweight and Parallel Deep Learning Framework☆263Updated 2 years ago
- Slicing a PyTorch Tensor Into Parallel Shards☆299Updated 3 years ago
- Tutorial for building a custom CUDA function for Pytorch☆516Updated 6 years ago
- PyTorch elastic training☆729Updated 2 years ago
- Experimental ground for optimizing memory of pytorch models☆366Updated 7 years ago
- Profiling and inspecting memory in pytorch☆1,060Updated 10 months ago
- Pipeline Parallelism for PyTorch☆767Updated 9 months ago
- Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial☆262Updated 2 years ago
- A general and accurate MACs / FLOPs profiler for PyTorch models☆614Updated last year
- Implementation of https://arxiv.org/abs/1904.00962☆375Updated 4 years ago
- PyTorch layer-by-layer model profiler☆607Updated 4 years ago
- The Tensor Algebra SuperOptimizer for Deep Learning☆714Updated 2 years ago
- A tensor-aware point-to-point communication primitive for machine learning☆257Updated 2 years ago
- Fast Block Sparse Matrices for Pytorch☆546Updated 4 years ago
- Efficient GPU kernels for block-sparse matrix multiplication and convolution☆1,040Updated last year
- Running BERT without Padding☆471Updated 3 years ago
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆685Updated 5 years ago
- TVM integration into PyTorch☆452Updated 5 years ago
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆818Updated this week
- Tutel MoE: Optimized Mixture-of-Experts Library, Support DeepSeek FP8/FP4☆829Updated this week
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,046Updated last year
- A LARS implementation in PyTorch☆345Updated 5 years ago
- PyTorch extensions for high performance and large scale training.☆3,328Updated last month
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆335Updated 10 months ago
- PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.☆430Updated last year
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆987Updated 8 months ago
- Collective communications library with various primitives for multi-machine training.☆1,306Updated last week
- Block-sparse primitives for PyTorch☆155Updated 4 years ago