waitwaitforget / modelparallel_pytorch
Model Parallelism for pytorch training multiple network on multiple GPUs.
☆28Updated 7 years ago
Alternatives and similar repositories for modelparallel_pytorch:
Users that are interested in modelparallel_pytorch are comparing it to the libraries listed below
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Updated 4 years ago
- This repository is no longer maintained. Check☆81Updated 5 years ago
- (Batched) advanced indexing for PyTorch.☆53Updated 3 months ago
- NeurIPS'19: Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting (Pytorch implementation for class imbalance).☆33Updated 5 years ago
- Distributed, mixed-precision training with PyTorch☆90Updated 4 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"☆98Updated 4 years ago
- tunz's CUDA pytorch operator (MaskedSoftmax)☆75Updated 6 years ago
- Filter Response Normalization tested on better ImageNet baselines.☆35Updated 5 years ago
- Code for Variational Laplace Autoencoders☆54Updated last year
- Non official pytorch implementation of i-Resnet, invertible residual networks.☆25Updated 3 years ago
- An implementation of shampoo☆74Updated 7 years ago
- an implementation of L0 regularization with PyTorch☆57Updated 7 years ago
- Masked Convolutional Flow☆59Updated 5 years ago
- PyTorch Implementations of Dropout Variants☆87Updated 7 years ago
- Implementation of "Variational Dropout and the Local Reparameterization Trick" paper with Pytorch☆49Updated 7 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆45Updated 5 years ago
- A PyTorch implementation of Conditional PixelCNNs☆27Updated 7 years ago
- PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆62Updated 8 months ago
- Backpropagation-Friendly-Eigendecomposition☆72Updated 5 years ago
- Implements pytorch code for the Accelerated SGD algorithm.☆215Updated 7 years ago
- [ICLR 2019] ProbGAN: Towards Probabilistic GAN with Theoretical Guarantees☆32Updated 5 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- PyTorch DataLoader processed in multiple remote computation machines for heavy data processings☆67Updated 5 years ago
- Linear-chain LSTM-CRFs and Convolutional CRFs in PyTorch.☆19Updated 7 years ago
- ☆47Updated 4 years ago
- PyTorch Implementation of CVPR'19 - On the Intrinsic Dimensionality of Image Representation☆23Updated 5 years ago
- Code base for SRSGD.☆28Updated 5 years ago
- Unofficial pytorch implementation of ReZero in ResNet☆23Updated 5 years ago
- LEARNING LATENT PERMUTATIONS WITH GUMBEL-SINKHORN NETWORKS IMPLEMENTATION WITH PYTORCH☆79Updated last year
- AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networks☆42Updated 7 years ago