richardkxu / distributed-pytorch
Distributed, mixed-precision training with PyTorch
☆90Updated 4 years ago
Alternatives and similar repositories for distributed-pytorch:
Users that are interested in distributed-pytorch are comparing it to the libraries listed below
- ☆165Updated 6 years ago
- Example code showing how to use Nvidia DALI in pytorch, with fallback to torchvision. Contains a few differences to the official Nvidia …☆197Updated 5 years ago
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Updated 4 years ago
- Utilities for Pytorch☆89Updated 2 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"☆98Updated 4 years ago
- ☆182Updated 2 years ago
- ☆62Updated 4 years ago
- A plug-in replacement for DataLoader to load Imagenet disk-sequentially in PyTorch.☆239Updated 3 years ago
- Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial☆261Updated 2 years ago
- ☆90Updated 6 years ago
- How and why you want to make your pytorch CUDA/CPP extension with a Makefile☆172Updated 5 years ago
- An official collection of code in different frameworks that reproduces experiments in "Group Normalization"☆118Updated 4 years ago
- A Pytorch implementation of "LegoNet: Efficient Convolutional Neural Networks with Lego Filters" (ICML 2019).☆140Updated 4 years ago
- Simple experiment of Apex (A PyTorch Extension)☆47Updated 5 years ago
- Sparse Switchable Normalization with sparse activation function SparestMax☆64Updated 5 years ago
- Synchronized Multi-GPU Batch Normalization☆223Updated 5 years ago
- Code for "Are labels necessary for neural architecture search"☆92Updated last year
- Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neu…☆148Updated 5 years ago
- A Re-implementation of Fixed-update Initialization☆153Updated 5 years ago
- Unofficial PyTorch Implementation of EvoNorm☆121Updated 3 years ago
- How to use Cross Replica / Synchronized Batchnorm in Pytorch☆248Updated 5 years ago
- PyTorch layer-by-layer model profiler☆606Updated 3 years ago
- A PyTorch implementation of " EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks."☆311Updated 5 years ago
- Useful PyTorch functions and modules that are not implemented in PyTorch by default☆187Updated 11 months ago
- Experimental ground for optimizing memory of pytorch models☆365Updated 6 years ago
- homura is a library for fast prototyping DL research☆107Updated 2 years ago
- On Network Design Spaces for Visual Recognition☆94Updated 4 years ago
- [ICLR 2020]: 'AtomNAS: Fine-Grained End-to-End Neural Architecture Search'☆222Updated 4 years ago
- An implementation of shampoo☆74Updated 7 years ago
- A PyTorch implementation of shake-shake☆111Updated 4 years ago