kaiyuyue / torchshardLinks
Slicing a PyTorch Tensor Into Parallel Shards
☆301Updated 4 months ago
Alternatives and similar repositories for torchshard
Users that are interested in torchshard are comparing it to the libraries listed below
Sorting:
- Accelerate training by storing parameters in one contiguous chunk of memory.☆293Updated 4 years ago
- A GPU performance profiling tool for PyTorch models☆508Updated 4 years ago
- MONeT framework for reducing memory consumption of DNN training☆174Updated 4 years ago
- Demystify RAM Usage in Multi-Process Data Loaders☆204Updated 2 years ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆199Updated 2 years ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆335Updated last year
- Implementation of https://arxiv.org/abs/1904.00962☆377Updated 4 years ago
- Implementation of a Transformer, but completely in Triton☆276Updated 3 years ago
- PyTorch layer-by-layer model profiler☆606Updated 4 years ago
- Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial☆264Updated 2 years ago
- A GPipe implementation in PyTorch☆857Updated last year
- Block-sparse primitives for PyTorch☆160Updated 4 years ago
- Experimental ground for optimizing memory of pytorch models☆367Updated 7 years ago
- A general and accurate MACs / FLOPs profiler for PyTorch models☆629Updated 2 months ago
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆251Updated 2 years ago
- Example code showing how to use Nvidia DALI in pytorch, with fallback to torchvision. Contains a few differences to the official Nvidia …☆198Updated 5 years ago
- Torch Distributed Experimental☆117Updated last year
- Fast Block Sparse Matrices for Pytorch☆547Updated 4 years ago
- Accelerate PyTorch models with ONNX Runtime☆365Updated 8 months ago
- PyTorch implementation of L2L execution algorithm☆108Updated 2 years ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆180Updated last month
- Library for 8-bit optimizers and quantization routines.☆780Updated 3 years ago
- This repository contains the results and code for the MLPerf™ Training v0.7 benchmark.☆57Updated 2 years ago
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆685Updated 5 years ago
- Simple package that makes your generator work in background thread☆282Updated 3 years ago
- A tensor-aware point-to-point communication primitive for machine learning☆273Updated 2 months ago
- ☆108Updated 4 years ago
- Efficient, check-pointed data loading for deep learning with massive data sets.☆209Updated 2 years ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆161Updated last month
- A LARS implementation in PyTorch☆352Updated 5 years ago