ryul99 / pytorch-project-template
Deep Learning project template for PyTorch (multi-gpu training is supported)
☆134Updated last year
Related projects ⓘ
Alternatives and complementary repositories for pytorch-project-template
- Simple project base template for PyTorch deep Learning project. Features clean implementation of DDP training and Hydra config.☆57Updated 2 years ago
- AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)☆415Updated 3 years ago
- Tool box for PyTorch☆186Updated 8 months ago
- ☆440Updated last year
- Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)☆208Updated this week
- Collection of PyTorch Lightning implementations of Generative Adversarial Network varieties presented in research papers.☆167Updated 2 years ago
- Implementation of Linformer for Pytorch☆257Updated 10 months ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆112Updated last year
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆119Updated 11 months ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆222Updated 2 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆406Updated last month
- ☆241Updated 2 years ago
- Useful PyTorch functions and modules that are not implemented in PyTorch by default☆187Updated 6 months ago
- A LARS implementation in PyTorch☆335Updated 4 years ago
- Distributed, mixed-precision training with PyTorch☆89Updated 4 years ago
- Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custo…☆88Updated 4 years ago
- Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)☆480Updated 3 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆209Updated 3 years ago
- PyTorch implementation of some learning rate schedulers for deep learning researcher.☆86Updated 2 years ago
- Learning Rate Warmup in PyTorch☆392Updated this week
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Updated 3 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"☆98Updated 3 years ago
- Learning Features with Parameter-Free Layers, ICLR 2022☆85Updated last year
- Provides everything needed for high performance data loading and augmentation in pytorch.☆316Updated 10 months ago
- 🎲 Iterable dataset resampling in PyTorch☆91Updated 2 years ago
- A collection of code snippets for my PyTorch Lightning projects☆107Updated 3 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 2 years ago
- A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.☆136Updated 2 years ago
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆192Updated last year
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆116Updated 3 years ago