NVlabs / AdaBatch
AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networks
☆41Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for AdaBatch
- ☆23Updated 6 years ago
- Delta Orthogonal Initialization for PyTorch☆18Updated 6 years ago
- NeurIPS'19: Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting (Pytorch implementation for class imbalance).☆34Updated 5 years ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Updated last year
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Updated 3 years ago
- ☆11Updated 4 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆16Updated 3 years ago
- Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."☆22Updated 5 years ago
- ☆22Updated 6 years ago
- Unofficial PyTorch implementation of "GAN-QP: A Novel GAN Framework without Gradient Vanishing and Lipschitz Constraint"☆30Updated 5 years ago
- ☆34Updated 5 years ago
- pytorch implementation of Structured Bayesian Pruning☆19Updated 6 years ago
- Net2Net implementation on PyTorch for any possible vision layers.☆38Updated 7 years ago
- The latest version of Net-Trim which solves the actual constrained problem☆24Updated 4 years ago
- High-Level Training, Data Augmentation, and Utilities for Pytorch☆13Updated 5 years ago
- Codes for accepted paper "Cooperative Pruning in Cross-Domain Deep Neural Network Compression" in IJCAI 2019.☆11Updated 5 years ago
- Deep Neural Network Compression based on Student-Teacher Network☆14Updated last year
- Dual Path Networks on cifar-10 and fashion-mnist datasets☆18Updated 7 years ago
- Code for "On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length", ICLR 2019☆11Updated last year
- PyTorch implementation of HashedNets☆36Updated last year
- Exploiting Uncertainty of Loss Landscape for Stochastic Optimization☆15Updated 5 years ago
- "Learning Rate Dropout" in PyTorch☆34Updated 4 years ago
- Codes for DATA: Differentiable ArchiTecture Approximation.☆11Updated 3 years ago
- Filter Response Normalization tested on better ImageNet baselines.☆35Updated 4 years ago
- Implementation of tools to control and monitor layer rotation in different DL libraries☆40Updated 5 years ago
- Code for BlockSwap (ICLR 2020).☆33Updated 3 years ago
- Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization at CVPR'19☆48Updated 5 years ago
- Simple implementation of the LSUV initialization in PyTorch☆58Updated 10 months ago
- This code is for running enas on nni.☆24Updated 5 years ago
- Code base for SRSGD.☆28Updated 4 years ago