yashkant / padam-tensorflow
Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge
☆51Updated 5 years ago
Alternatives and similar repositories for padam-tensorflow:
Users that are interested in padam-tensorflow are comparing it to the libraries listed below
- The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.☆20Updated last year
- This repository has moved to: https://github.com/tkipf/c-swm☆27Updated 5 years ago
- Code base for SRSGD.☆28Updated 4 years ago
- implements various optimizers from scratch for analysis and comparison☆9Updated 4 years ago
- Optimization and Generalization Analysis of Transduction through Gradient Boosting and Application to Multi-scale Graph Neural Networks☆13Updated 4 years ago
- Repository with code for paper "Inhibited Softmax for Uncertainty Estimation in Neural Networks"☆25Updated 5 years ago
- Anonymous Repository for ICML LRG Workshop: On Explainability Techniques for Graph Convolutional Networks☆23Updated 5 years ago
- ☆61Updated last year
- Deep neural architecture research framework☆12Updated last year
- Implementation of Kronecker Attention in Pytorch☆18Updated 4 years ago
- ☆24Updated 9 months ago
- Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…☆17Updated 5 years ago
- Official code for NeurIPS paper "Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approach".☆16Updated 2 years ago
- Toy implementations of some popular ML optimizers using Python/JAX☆44Updated 3 years ago
- A disciplined approach to neural network parameters - Reviewing the approach for setting Hyper parameters by Leslie Smith☆11Updated 6 years ago
- A PyTorch implement of Dilated RNN☆11Updated 7 years ago
- The Deep Weight Prior, ICLR 2019☆44Updated 3 years ago
- Implemented Split-Brain Autoencoder by Zhang et al.☆8Updated 6 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆21Updated 3 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆48Updated 5 years ago
- ☆26Updated 5 years ago
- Repository for the code of the paper "Neural Networks Regularization Through Class-wise Invariant Representation Learning".☆12Updated 7 years ago
- Code for "Deep Convolutional Networks as shallow Gaussian Processes"☆16Updated 5 years ago
- Code for the paper "Mean Spectral Normalization"☆9Updated 5 years ago
- Code for "Exponential Family Estimation via Adversarial Dynamics Embedding" (NeurIPS 2019)☆13Updated 5 years ago
- Code for Unbiased Implicit Variational Inference (UIVI)☆13Updated 6 years ago
- NeurIPS 2019 Paper Implementation☆12Updated 2 years ago
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Updated 3 years ago
- Source code for ICLR 2020 paper: "Learning to Guide Random Search"☆39Updated 5 months ago
- ☆24Updated 5 years ago