richardkxu / distributed-pytorch
Distributed, mixed-precision training with PyTorch
☆90Updated 4 years ago
Alternatives and similar repositories for distributed-pytorch:
Users that are interested in distributed-pytorch are comparing it to the libraries listed below
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Updated 4 years ago
- Utilities for Pytorch☆89Updated 2 years ago
- ☆182Updated 2 years ago
- A plug-in replacement for DataLoader to load Imagenet disk-sequentially in PyTorch.☆239Updated 3 years ago
- Example code showing how to use Nvidia DALI in pytorch, with fallback to torchvision. Contains a few differences to the official Nvidia …☆197Updated 5 years ago
- Code for "Are labels necessary for neural architecture search"☆92Updated last year
- Simple experiment of Apex (A PyTorch Extension)☆47Updated 5 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"☆98Updated 4 years ago
- ☆165Updated 6 years ago
- ☆261Updated 5 years ago
- Filter Response Normalization tested on better ImageNet baselines.☆35Updated 5 years ago
- An official collection of code in different frameworks that reproduces experiments in "Group Normalization"☆118Updated 4 years ago
- Unofficial PyTorch Implementation of EvoNorm☆121Updated 3 years ago
- How and why you want to make your pytorch CUDA/CPP extension with a Makefile☆172Updated 5 years ago
- ☆62Updated 4 years ago
- ☆90Updated 6 years ago
- A Re-implementation of Fixed-update Initialization☆153Updated 5 years ago
- Full implementation of the paper "Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator".☆101Updated 5 years ago
- A LARS implementation in PyTorch☆345Updated 5 years ago
- Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons (AAAI 2019)☆104Updated 5 years ago
- [NeurIPS'20] GradAug: A New Regularization Method for Deep Neural Networks☆93Updated 4 years ago
- Code release for paper "Random Search and Reproducibility for NAS"☆167Updated 5 years ago
- On Network Design Spaces for Visual Recognition☆95Updated 5 years ago
- PyTorch implementation of shake-drop regularization☆54Updated 5 years ago
- An implementation of shampoo☆74Updated 7 years ago
- A PyTorch implementation of shake-shake☆111Updated 5 years ago
- Useful PyTorch functions and modules that are not implemented in PyTorch by default☆187Updated last year
- Filter Response Normalization Layer in PyTorch☆121Updated 5 years ago
- How to use Cross Replica / Synchronized Batchnorm in Pytorch☆248Updated 5 years ago
- Pytorch implementation of group normalization in https://arxiv.org/abs/1803.08494 (Following the PyTorch Style)☆87Updated 6 years ago