yanni-georghiades / Nadam-v.-Adam
Comparison of Adam and Nadam optimization algorithms using example problems: linear least squares regression, logistic regression, and a small CNN
☆9Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for Nadam-v.-Adam
- (unofficial) - customized fork of DETR, optimized for intelligent obj detection on 'real world' custom datasets☆12Updated 4 years ago
- diffGrad: An Optimization Method for Convolutional Neural Networks☆54Updated 2 years ago
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 2 years ago
- Implementation for ACProp ( Momentum centering and asynchronous update for adaptive gradient methdos, NeurIPS 2021)☆15Updated 3 years ago
- A simple implementation of a deep linear Pytorch module☆18Updated 4 years ago
- Implementation of Kronecker Attention in Pytorch☆17Updated 4 years ago
- Unsupervised Data Augmentation experiments in PyTorch☆59Updated 5 years ago
- ☆47Updated 3 years ago
- AIMS 2020, class on Visual Recognition☆23Updated 4 years ago
- An education step by step implementation of SimCLR that accompanies the blogpost☆31Updated 2 years ago
- Code accompanying our NeurIPS 2020 traffic4cast challenge☆13Updated 3 years ago
- Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training …☆18Updated 2 years ago
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆36Updated 3 years ago
- ☆54Updated 3 years ago
- This repository provides the code for replicating the experiments in the paper "Building One-Shot Semi-supervised (BOSS) Learning up to F…☆36Updated 4 years ago
- Axial Positional Embedding for Pytorch☆61Updated 3 years ago
- Pytorch code for managing distributed training experiments.☆20Updated 4 years ago
- The implementation of paper ''Efficient Attention Network: Accelerate Attention by Searching Where to Plug''.☆20Updated last year
- Loss-Balanced Task Weighting to Reduce Negative Transfer in Multi-Task Learning, AAAI-SA'19☆29Updated 5 years ago
- Implementation of the spotlight: a method for discovering systematic errors in deep learning models☆10Updated 3 years ago
- ☆25Updated 4 years ago
- Fine-grained ImageNet annotations☆29Updated 4 years ago
- Active and Sample-Efficient Model Evaluation☆24Updated 3 years ago
- Utilities for Deep Learning with PyTorch (models, losses, metrics etc.)☆14Updated 4 years ago
- ☆34Updated 4 years ago
- Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆21Updated 2 years ago
- Bootstrap Your Own Latent (BYOL) pytorch implementation using DistributedDataParallel.☆28Updated last year
- Packaged TResNet based on Official PyTorch Implementation☆15Updated 4 years ago