yashkant / padam-tensorflow
Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge
☆51Updated 5 years ago
Alternatives and similar repositories for padam-tensorflow:
Users that are interested in padam-tensorflow are comparing it to the libraries listed below
- Code base for SRSGD.☆28Updated 5 years ago
- The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.☆20Updated last year
- A PyTorch implement of Dilated RNN☆11Updated 7 years ago
- Official PyTorch implementation of the paper : ProbAct: A Probabilistic Activation Function for Deep Neural Networks.☆13Updated 5 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆21Updated 3 years ago
- Repository for the code of the paper "Neural Networks Regularization Through Class-wise Invariant Representation Learning".☆12Updated 7 years ago
- Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…☆17Updated 5 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆45Updated 5 years ago
- Source code for ICLR 2020 paper: "Learning to Guide Random Search"☆39Updated 7 months ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆47Updated 5 years ago
- Code for "Deep Convolutional Networks as shallow Gaussian Processes"☆16Updated 5 years ago
- Reversible Recurrent Neural Network Pytorch Implementation☆21Updated 7 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆17Updated 4 years ago
- ☆34Updated 6 years ago
- Interpolation between Residual and Non-Residual Networks, ICML 2020. https://arxiv.org/abs/2006.05749☆26Updated 4 years ago
- A pytorch implementation of Information Bottleneck GAN☆28Updated 6 years ago
- Official code for NeurIPS paper "Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approach".☆16Updated 2 years ago
- This repository has moved to: https://github.com/tkipf/c-swm☆27Updated 5 years ago
- Computing various norms/measures on over-parametrized neural networks☆49Updated 6 years ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Updated last year
- [JMLR] TRADES + random smoothing for certifiable robustness☆14Updated 4 years ago
- Pretrained TorchVision models on CIFAR10 dataset (with weights)☆24Updated 4 years ago
- implements various optimizers from scratch for analysis and comparison☆9Updated 4 years ago
- [NeurIPS'19] [PyTorch] Adaptive Regularization in NN☆68Updated 5 years ago
- Experiments with Neural ODEs and Adversarial Attacks☆44Updated 6 years ago
- Deep neural architecture research framework☆12Updated 2 years ago
- Code for Unbiased Implicit Variational Inference (UIVI)☆14Updated 6 years ago
- Fine-grained ImageNet annotations☆29Updated 4 years ago
- An adaptive training algorithm for residual network☆15Updated 4 years ago
- Delta Orthogonal Initialization for PyTorch☆18Updated 6 years ago