YanaiEliyahu / AdasOptimizerLinks
ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achieving state-of-the-art training performance
☆85Updated 4 years ago
Alternatives and similar repositories for AdasOptimizer
Users that are interested in AdasOptimizer are comparing it to the libraries listed below
Sorting:
- TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.☆88Updated 4 years ago
- Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.☆85Updated 4 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".…☆30Updated 4 years ago
- ☆76Updated last year
- Lite Inference Toolkit (LIT) for PyTorch☆161Updated 3 years ago
- a mini Deep Learning framework supporting GPU accelerations written with CUDA☆32Updated 4 years ago
- Zalo AI Challenge 2020 - Top 2 @ Voice Verification☆15Updated 3 years ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆217Updated 4 years ago
- Implementation of self-supervised image-level contrastive pretraining methods using Keras.☆70Updated 4 years ago
- graftr: an interactive shell to view and edit PyTorch checkpoints.☆114Updated 5 years ago
- TensorFlow port of PyTorch Image Models (timm) - image models with pretrained weights.☆290Updated last year
- Deep Learning project template best practices with Pytorch Lightning, Hydra, Tensorboard.☆159Updated 4 years ago
- Official code for the Stochastic Polyak step-size optimizer☆139Updated last year
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆128Updated last year
- ☆54Updated 5 years ago
- Light Face Detection using PyTorch Lightning☆82Updated 2 years ago
- Instantly improve your training performance of TensorFlow models with just 2 lines of code!☆105Updated 3 years ago
- Cyclemoid implementation for PyTorch☆90Updated 3 years ago
- Unofficial PyTorch Implementation of EvoNorm☆123Updated 4 years ago
- Implementation of Feedback Transformer in Pytorch☆108Updated 4 years ago
- AutoML for image augmentation. AutoAlbument uses the Faster AutoAugment algorithm to find optimal augmentation policies. Documentation - …☆207Updated 4 years ago
- Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.☆34Updated 5 years ago
- PyTorch dataset extended with map, cache etc. (tensorflow.data like)☆330Updated 3 years ago
- Code for scaling Transformers☆26Updated 4 years ago
- PyTorch implementation of L2L execution algorithm☆108Updated 2 years ago
- Minimal implementation of SimSiam (https://arxiv.org/abs/2011.10566) in TensorFlow 2.☆98Updated 4 years ago
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆61Updated 3 years ago
- a lightweight transformer library for PyTorch☆72Updated 4 years ago
- Aloception is a set of package for computer vision: aloscene, alodataset, alonet.☆93Updated 5 months ago
- Data Reading Blocks for Python☆104Updated 4 years ago