yashkant / padam-tensorflow
Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge
☆51Updated 6 years ago
Alternatives and similar repositories for padam-tensorflow:
Users that are interested in padam-tensorflow are comparing it to the libraries listed below
- Code base for SRSGD.☆28Updated 5 years ago
- Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…☆17Updated 5 years ago
- Code for "Bridging the Gap between f-GANs and Wasserstein GANs", ICML 2020☆14Updated 4 years ago
- The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.☆20Updated last year
- ☆24Updated 11 months ago
- Code for "Exponential Family Estimation via Adversarial Dynamics Embedding" (NeurIPS 2019)☆13Updated 5 years ago
- A PyTorch implement of Dilated RNN☆11Updated 7 years ago
- ☆24Updated 5 years ago
- Repository containing code for getting statistical guarantees on properties of BNNs☆13Updated 6 years ago
- Anonymous Repository for ICML LRG Workshop: On Explainability Techniques for Graph Convolutional Networks☆23Updated 5 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆45Updated 5 years ago
- implements various optimizers from scratch for analysis and comparison☆9Updated 5 years ago
- Implementation of the models and datasets used in "An Information-theoretic Approach to Distribution Shifts"☆25Updated 3 years ago
- ☆16Updated 5 years ago
- ☆26Updated 6 years ago
- The Shape of Data: Intrinsic Distance for Comparing Data Distributions☆12Updated 5 years ago
- SparseMax activation function implementation (ICML 2016) (PyTorch)☆27Updated 7 years ago
- JAX implementation of Graph Attention Networks☆13Updated 3 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆21Updated 3 years ago
- Code for Unbiased Implicit Variational Inference (UIVI)☆14Updated 6 years ago
- rich posterior approximations and anomaly detection☆20Updated 6 years ago
- ☆33Updated 6 years ago
- Interpolation between Residual and Non-Residual Networks, ICML 2020. https://arxiv.org/abs/2006.05749☆26Updated 4 years ago
- TensorFlow implementation of "noisy K-FAC" and "noisy EK-FAC".☆60Updated 6 years ago
- Official PyTorch implementation of the paper : ProbAct: A Probabilistic Activation Function for Deep Neural Networks.☆13Updated 5 years ago
- Reproducible code for Augmentation paper☆17Updated 6 years ago
- Optimization and Generalization Analysis of Transduction through Gradient Boosting and Application to Multi-scale Graph Neural Networks☆13Updated 4 years ago
- Computing various norms/measures on over-parametrized neural networks☆49Updated 6 years ago
- CVPR 2019 paper "Disentangling Adversarial Robustness and Generalization".☆14Updated 5 years ago
- ☆61Updated 2 years ago