YanaiEliyahu / AdasOptimizer
ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achieving state-of-the-art training performance
☆85Updated 4 years ago
Alternatives and similar repositories for AdasOptimizer
Users that are interested in AdasOptimizer are comparing it to the libraries listed below
Sorting:
- ☆14Updated 4 years ago
- Implementation of Feedback Transformer in Pytorch☆105Updated 4 years ago
- Unofficial PyTorch Implementation of EvoNorm☆121Updated 3 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".…☆30Updated 4 years ago
- Auto-Magical Deploy AI model at large scale, high performance, and easy to use☆66Updated last year
- a mini Deep Learning framework supporting GPU accelerations written with CUDA☆32Updated 4 years ago
- graftr: an interactive shell to view and edit PyTorch checkpoints.☆113Updated 4 years ago
- TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.☆87Updated 3 years ago
- a lightweight transformer library for PyTorch☆71Updated 3 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Updated 4 years ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆214Updated 4 years ago
- Implementation of self-supervised image-level contrastive pretraining methods using Keras.☆70Updated 3 years ago
- Useful PyTorch functions and modules that are not implemented in PyTorch by default☆187Updated last year
- Cyclemoid implementation for PyTorch☆90Updated 3 years ago
- Lite Inference Toolkit (LIT) for PyTorch☆161Updated 3 years ago
- Zalo AI Challenge 2020 - Top 2 @ Voice Verification☆15Updated 2 years ago
- ☆47Updated 4 years ago
- Knowledge Distillation Toolkit☆88Updated 4 years ago
- Repository to perform simple pruning experiments on neural networks☆18Updated 4 years ago
- Deep Learning project template best practices with Pytorch Lightning, Hydra, Tensorboard.☆159Updated 4 years ago
- Light Face Detection using PyTorch Lightning☆84Updated last year
- Self Driving Car for Digital Race contest that is sponsored by FPT Corp.☆24Updated 4 years ago
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆60Updated 3 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆225Updated 3 years ago
- 1st place solution for SIIM-FISABIO-RSNA COVID-19 Detection Challenge☆176Updated 3 years ago
- Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.☆84Updated 3 years ago
- Official code for the Stochastic Polyak step-size optimizer☆139Updated 10 months ago
- ☆18Updated 2 years ago
- An open source implementation of CLIP.☆32Updated 2 years ago
- My implementation of DeepMind's Perceiver☆63Updated 4 years ago