MONeT framework for reducing memory consumption of DNN training
☆174May 4, 2021Updated 4 years ago
Alternatives and similar repositories for MONeT
Users that are interested in MONeT are comparing it to the libraries listed below
Sorting:
- [NeurIPS'20] GradAug: A New Regularization Method for Deep Neural Networks☆94Dec 16, 2020Updated 5 years ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆199Dec 22, 2022Updated 3 years ago
- PyTorch implementation of L2L execution algorithm☆108Jan 16, 2023Updated 3 years ago
- The implementation of "Shape Adaptor: A Learnable Resizing Module" [ECCV 2020].☆72Mar 10, 2021Updated 4 years ago
- The code for Joint Neural Architecture Search and Quantization☆14Apr 10, 2019Updated 6 years ago
- sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data☆66Jul 25, 2024Updated last year
- Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616☆133Jul 6, 2023Updated 2 years ago
- Using ideas from product quantization for state-of-the-art neural network compression.☆145Aug 14, 2021Updated 4 years ago
- ☆23Apr 28, 2023Updated 2 years ago
- Code for "Bridging the Gap between f-GANs and Wasserstein GANs", ICML 2020☆14Jul 18, 2020Updated 5 years ago
- Implementation of DropLoss for Long-Tail Instance Segmentation in Pytorch☆42Apr 14, 2021Updated 4 years ago
- PyTorch layer-by-layer model profiler☆607May 23, 2021Updated 4 years ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆137Feb 21, 2022Updated 4 years ago
- ☆41Jun 18, 2021Updated 4 years ago
- Unofficial PyTorch Implementation of EvoNorm☆123Aug 29, 2021Updated 4 years ago
- ☆41Apr 3, 2021Updated 4 years ago
- Research and development for optimizing transformers☆131Feb 16, 2021Updated 5 years ago
- The Tensor Algebra SuperOptimizer for Deep Learning☆739Jan 26, 2023Updated 3 years ago
- Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"☆1,068Aug 9, 2024Updated last year
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆20Jul 7, 2022Updated 3 years ago
- AReLU: Attention-based-Rectified-Linear-Unit☆62Sep 3, 2021Updated 4 years ago
- A GPipe implementation in PyTorch☆863Jul 25, 2024Updated last year
- ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting (ICCV 2021)☆300Dec 1, 2022Updated 3 years ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆1,006Sep 19, 2024Updated last year
- Easy Multiprocessing for Python☆42Nov 3, 2020Updated 5 years ago
- ☆42Sep 8, 2023Updated 2 years ago
- Haskell experiments involving TVM AI framework☆20Apr 26, 2019Updated 6 years ago
- ☆12Sep 26, 2019Updated 6 years ago
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆16Oct 11, 2021Updated 4 years ago
- ☆57Dec 8, 2020Updated 5 years ago
- [ICIP 2019] : Official PyTorch implementation of the paper "What's There in The Dark" accepted in IEEE International Conference in Image …☆30Dec 15, 2022Updated 3 years ago
- Post-training sparsity-aware quantization☆34Feb 26, 2023Updated 3 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆20Dec 28, 2021Updated 4 years ago
- Improved Residual Networks (https://arxiv.org/pdf/2004.04989.pdf)☆249Jul 16, 2022Updated 3 years ago
- [TPAMI2022 & NeurIPS2020] Official implementation of Self-Adaptive Training☆130Oct 17, 2021Updated 4 years ago
- PyTorch extensions for high performance and large scale training.☆3,400Apr 26, 2025Updated 10 months ago
- ☆24Jun 22, 2022Updated 3 years ago
- Official Pytorch Implementation of "TResNet: High-Performance GPU-Dedicated Architecture" (WACV 2021)☆478Dec 10, 2024Updated last year
- Implementation for ECCV 2020 paper: AABO: Adaptive Anchor Box Optimization for Object Detection via Bayesian Sub-sampling.☆30Aug 23, 2020Updated 5 years ago