sayakpaul / Adaptive-Gradient-Clipping
Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.
☆83Updated 3 years ago
Alternatives and similar repositories for Adaptive-Gradient-Clipping:
Users that are interested in Adaptive-Gradient-Clipping are comparing it to the libraries listed below
- An open source implementation of CLIP.☆32Updated 2 years ago
- Experiments with the ideas presented in https://arxiv.org/abs/2003.00152 by Frankle et al.☆29Updated 4 years ago
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆60Updated 3 years ago
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆127Updated last year
- Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch☆59Updated 4 years ago
- Implementation of Kronecker Attention in Pytorch☆18Updated 4 years ago
- Cyclemoid implementation for PyTorch☆87Updated 2 years ago
- This is the code base for paper "G-SimCLR : Self-Supervised Contrastive Learning with Guided Projection via Pseudo Labelling" by Souradip…☆76Updated 3 years ago
- pytest plugin for a better developer experience when working with the PyTorch test suite☆44Updated 3 years ago
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated last year
- Unofficial pytorch implementation of ReZero in ResNet☆23Updated 4 years ago
- GAN models implemented with Pytorch Lightning and Hydra configuration☆34Updated 2 years ago
- Unofficial PyTorch Implementation of EvoNorm☆121Updated 3 years ago
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- Utilities for working with W&B and PyTorch Lightning in an educational context☆15Updated 3 years ago
- ☆47Updated 4 years ago
- Implementation of modern data augmentation techniques in TensorFlow 2.x to be used in your training pipeline.☆34Updated 4 years ago
- High Performance Tensorflow Data Pipeline with State of Art Augmentations and low level optimizations.☆86Updated 2 years ago
- TF2.0 port for Augmix paper☆79Updated 5 years ago
- A crash course on PyTorch hooks☆40Updated 4 years ago
- ☆54Updated 3 years ago
- (unofficial) - customized fork of DETR, optimized for intelligent obj detection on 'real world' custom datasets☆12Updated 4 years ago
- Official PyTorch code for U-Noise: Learnable Noise Masks for Interpretable Image Segmentation (ICIP 2021)☆40Updated 3 years ago
- TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.☆87Updated 3 years ago
- ☆12Updated 2 years ago
- Implementation of Feedback Transformer in Pytorch☆105Updated 3 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- Implements MLP-Mixer (https://arxiv.org/abs/2105.01601) with the CIFAR-10 dataset.☆54Updated 2 years ago
- ☆66Updated 3 years ago
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated 2 years ago