Code to reproduce some of the figures in the paper "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima"
☆147Apr 24, 2017Updated 9 years ago
Alternatives and similar repositories for large-batch-training
Users that are interested in large-batch-training are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning☆23Nov 21, 2018Updated 7 years ago
- Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training o…☆148May 25, 2017Updated 9 years ago
- Code for "On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length", ICLR 2019☆11Dec 8, 2022Updated 3 years ago
- Torch implementation reproducing MNIST experiments from DeepMind's DNI paper.☆44Mar 4, 2017Updated 9 years ago
- Analyze the dynamic stability of SGD☆13Nov 25, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- DNI(Decoupled Neural Interfaces using Synthetic Gradients) implementation with Torch☆30Aug 30, 2016Updated 10 years ago
- PyTorch bindings for openai-gemm☆20Feb 6, 2017Updated 9 years ago
- ☆256Nov 23, 2016Updated 9 years ago
- Low-rank Highway Networks☆13Mar 11, 2016Updated 10 years ago
- Recurrent Convolutional Memory Network (in progress)☆29Apr 16, 2016Updated 10 years ago
- An empirical investigation of deep learning theory☆16Oct 3, 2019Updated 7 years ago
- Movielens collaborative filtering with Solr streaming expression☆10Oct 13, 2016Updated 10 years ago
- Residual Network of Residual Networks in Keras☆23May 23, 2017Updated 9 years ago
- Neural network training using iterated projections.☆88Jan 17, 2017Updated 9 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Progressive Attention Networks☆12Oct 25, 2016Updated 10 years ago
- Deep Learning Dashboard☆39Sep 4, 2016Updated 10 years ago
- Finalist entry for the M2CAI Workflow Challenge 2016☆10Nov 25, 2016Updated 9 years ago
- Structured Prediction Energy Networks in Torch☆133Feb 8, 2017Updated 9 years ago
- Torch implementation of the paper "Deep Pyramidal Residual Networks" (https://arxiv.org/abs/1610.02915).☆131Oct 31, 2017Updated 9 years ago
- Code and models from the paper "Layer Normalization"☆243Nov 8, 2016Updated 9 years ago
- ☆69Dec 19, 2018Updated 7 years ago
- Lua implementation of Entropy-SGD☆80Apr 9, 2018Updated 8 years ago
- Tweet Classification using RNN and CNN☆43Sep 18, 2016Updated 10 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Datasets for Hyperparameter Optimization of Neural Machine Translation☆10Aug 19, 2024Updated 2 years ago
- [ICLR'22] Self-supervised learning optimally robust representations for domain shift.☆25Feb 2, 2022Updated 4 years ago
- Reference caffe implementation of LSUV initialization☆114Oct 31, 2017Updated 9 years ago
- Script to perform dictionary based n-gram text tagging efficiently in apache spark☆10Sep 30, 2016Updated 10 years ago
- [ICML 2019] The Anisotropic Noise in Stochastic Gradient Descent: Its Behavior of Escaping from Sharp Minima and Regularization Effects☆15Apr 12, 2020Updated 6 years ago
- Lasagne code for weight normalization☆88Apr 3, 2016Updated 10 years ago
- ☆17Aug 22, 2017Updated 9 years ago
- A rudimentary wrapper around the fast Maxwell kernels for GEMM and convolution operations provided by nervanagpu☆34May 7, 2015Updated 11 years ago
- 3.8% and 18.3% on CIFAR-10 and CIFAR-100☆1,315Aug 20, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Implementation of Shake-Shake by chainer (Shake-Shake regularization of 3-branch residual networks: https://openreview.net/forum?id=HkO-P…☆10Aug 24, 2017Updated 9 years ago
- Implementation of average- and worst-case robust flatness measures for adversarial training.☆15Nov 5, 2021Updated 5 years ago
- ☆12Oct 8, 2016Updated 10 years ago
- an updated version of fb.resnet.torch with many changes.☆38Dec 16, 2016Updated 9 years ago
- Example code for Weight Normalization, from "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Netw…☆365Nov 22, 2018Updated 7 years ago
- Example code for the paper "Understanding deep learning requires rethinking generalization"☆179Jun 2, 2020Updated 6 years ago
- Wide Residual Networks (WideResNets) in PyTorch☆347Apr 29, 2021Updated 5 years ago