ryul99 / pytorch-project-template
Deep Learning project template for PyTorch (multi-gpu training is supported)
☆134Updated last year
Related projects: ⓘ
- Simple project base template for PyTorch deep Learning project. Features clean implementation of DDP training and Hydra config.☆57Updated last year
- A LARS implementation in PyTorch☆332Updated 4 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆221Updated 2 years ago
- Implementation of Linformer for Pytorch☆244Updated 8 months ago
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆164Updated 2 years ago
- Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)☆480Updated 3 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆112Updated last year
- Tool box for PyTorch☆184Updated 5 months ago
- Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)☆207Updated this week
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆118Updated 9 months ago
- PyTorch implementation of some learning rate schedulers for deep learning researcher.☆86Updated 2 years ago
- Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custo…☆89Updated 4 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆400Updated 2 years ago
- Distributed, mixed-precision training with PyTorch☆90Updated 4 years ago
- AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)☆413Updated 3 years ago
- ☆433Updated last year
- An implementation of the efficient attention module.☆272Updated 3 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆207Updated 3 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Updated 3 years ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆212Updated 3 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆123Updated 2 years ago
- Check gradient flow in Pytorch☆85Updated 5 years ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆119Updated 3 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- Implementation of Fast Transformer in Pytorch☆171Updated 3 years ago
- ☆241Updated 3 years ago
- 🎲 Iterable dataset resampling in PyTorch☆91Updated 2 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆137Updated 3 years ago
- Implementation of ResMLP, an all MLP solution to image classification, in Pytorch☆191Updated last year
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆191Updated last year