jianweif / OptimalGradCheckpointingLinks
☆41Updated 4 years ago
Alternatives and similar repositories for OptimalGradCheckpointing
Users that are interested in OptimalGradCheckpointing are comparing it to the libraries listed below
Sorting:
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆199Updated 3 years ago
- Code for ICML 2021 submission☆35Updated 4 years ago
- pytorch-profiler☆50Updated 2 years ago
- ☆160Updated 2 years ago
- ☆10Updated 4 years ago
- Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616☆133Updated 2 years ago
- All about acceleration and compression of Deep Neural Networks☆33Updated 6 years ago
- ☆222Updated 2 years ago
- code for the paper "A Statistical Framework for Low-bitwidth Training of Deep Neural Networks"☆29Updated 5 years ago
- ☆244Updated 3 years ago
- Codes for Accepted Paper : "MetaQuant: Learning to Quantize by Learning to Penetrate Non-differentiable Quantization" in NeurIPS 2019☆54Updated 5 years ago
- ☆43Updated 2 years ago
- code for NASViT☆67Updated 3 years ago
- AlphaNet Improved Training of Supernet with Alpha-Divergence☆100Updated 4 years ago
- code for "AttentiveNAS Improving Neural Architecture Search via Attentive Sampling"☆105Updated 4 years ago
- [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion☆41Updated 4 years ago
- a high performance system for customized-precision distributed deep learning☆12Updated 5 years ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆137Updated 3 years ago
- source code of the paper: Robust Quantization: One Model to Rule Them All☆41Updated 2 years ago
- Python pdb for multiple processes☆80Updated 8 months ago
- ☆69Updated 5 years ago
- Accuracy 77%. Large batch deep learning optimizer LARS for ImageNet with PyTorch and ResNet, using Horovod for distribution. Optional acc…☆38Updated 4 years ago
- ☆43Updated 3 years ago
- Generic Neural Architecture Search via Regression (NeurIPS'21 Spotlight)☆36Updated 3 years ago
- Distributed DataLoader For Pytorch Based On Ray☆24Updated 4 years ago
- A research library for pytorch-based neural network pruning, compression, and more.☆162Updated 3 years ago
- ☆115Updated last year
- [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …☆73Updated 3 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆55Updated 4 years ago
- Torch Distributed Experimental☆117Updated last year