sayakpaul / Adaptive-Gradient-ClippingLinks
Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.
☆85Updated 4 years ago
Alternatives and similar repositories for Adaptive-Gradient-Clipping
Users that are interested in Adaptive-Gradient-Clipping are comparing it to the libraries listed below
Sorting:
- Experiments with the ideas presented in https://arxiv.org/abs/2003.00152 by Frankle et al.☆29Updated 5 years ago
- This is the code base for paper "G-SimCLR : Self-Supervised Contrastive Learning with Guided Projection via Pseudo Labelling" by Souradip…☆79Updated 3 years ago
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆61Updated 3 years ago
- An open source implementation of CLIP.☆33Updated 2 years ago
- Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.☆34Updated 5 years ago
- Cyclemoid implementation for PyTorch☆90Updated 3 years ago
- Pruning applied to Facial Recognition.☆15Updated 6 years ago
- "Learning Rate Dropout" in PyTorch☆34Updated 5 years ago
- Unofficial PyTorch Implementation of EvoNorm☆122Updated 4 years ago
- a lightweight transformer library for PyTorch☆72Updated 3 years ago
- Implementation of Kronecker Attention in Pytorch☆19Updated 5 years ago
- ☆54Updated 3 years ago
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆128Updated last year
- ☆47Updated 4 years ago
- Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch☆59Updated 4 years ago
- This repository provides the code for replicating the experiments in the paper "Building One-Shot Semi-supervised (BOSS) Learning up to F…☆36Updated 5 years ago
- Neural Arithmetic Logic Units by Trask et al.☆12Updated 6 years ago
- GAN models implemented with Pytorch Lightning and Hydra configuration☆33Updated 3 years ago
- FasterAI: A repository for making smaller and faster models with the FastAI library.☆35Updated last year
- TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.☆88Updated 4 years ago
- Unofficial pytorch implementation of ReZero in ResNet☆24Updated 5 years ago
- diffGrad: An Optimization Method for Convolutional Neural Networks☆55Updated 2 years ago
- Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'☆38Updated 3 years ago
- Implementation of the Remixer Block from the Remixer paper, in Pytorch☆36Updated 4 years ago
- Pytorch augmentation☆119Updated last year
- A GPT, made only of MLPs, in Jax☆58Updated 4 years ago
- (partial) replication of results from https://arxiv.org/abs/1912.07768☆26Updated 5 years ago
- ImageNet training code that implements academic defaults☆12Updated 4 years ago
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated 2 years ago
- (unofficial) - customized fork of DETR, optimized for intelligent obj detection on 'real world' custom datasets☆12Updated 5 years ago