yashkant / padam-tensorflowLinks
Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge
☆51Updated 6 years ago
Alternatives and similar repositories for padam-tensorflow
Users that are interested in padam-tensorflow are comparing it to the libraries listed below
Sorting:
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆47Updated 5 years ago
- ☆34Updated 6 years ago
- The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.☆20Updated 2 years ago
- Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…☆17Updated 6 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆20Updated 4 years ago
- ☆61Updated 2 years ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Updated 2 years ago
- Code for paper 'Minimizing FLOPs to Learn Efficient Sparse Representations' published at ICLR 2020☆19Updated 5 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆48Updated 6 years ago
- [ICLR 2020] FSPool: Learning Set Representations with Featurewise Sort Pooling☆41Updated 2 years ago
- PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆62Updated last year
- Code release to reproduce ASHA experiments from "Random Search and Reproducibility for NAS."☆22Updated 6 years ago
- This repository has moved to: https://github.com/tkipf/c-swm☆27Updated 6 years ago
- [ICLR 2019] Learning Representations of Sets through Optimized Permutations☆36Updated 6 years ago
- Code base for SRSGD.☆28Updated 5 years ago
- Official code for NeurIPS paper "Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approach".☆16Updated 3 years ago
- [NeurIPS'19] [PyTorch] Adaptive Regularization in NN☆68Updated 6 years ago
- Transformers are Graph Neural Networks!☆54Updated 5 years ago
- Source code for ICLR 2020 paper: "Learning to Guide Random Search"☆40Updated last year
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆31Updated 4 years ago
- A PyTorch implement of Dilated RNN☆11Updated 8 years ago
- Repository for the code of the paper "Neural Networks Regularization Through Class-wise Invariant Representation Learning".☆12Updated 8 years ago
- Uniform Writing & Cached Uniform Writing☆27Updated 6 years ago
- An implementation of 2021 paper by Geoffrey Hinton: "How to represent part-whole hierarchies in a neural network" in Pytorch.☆57Updated 4 years ago
- A pytorch implementation of Information Bottleneck GAN☆28Updated 6 years ago
- Proceedings of ICML 2019☆33Updated 4 months ago
- A disciplined approach to neural network parameters - Reviewing the approach for setting Hyper parameters by Leslie Smith☆12Updated 7 years ago
- Official PyTorch implementation of the paper : ProbAct: A Probabilistic Activation Function for Deep Neural Networks.☆13Updated 6 years ago
- Material for my Caltech tutorial on deep learning and tensor methods☆70Updated 7 years ago
- CVPR 2019 paper "Disentangling Adversarial Robustness and Generalization".☆14Updated 6 years ago