Alternatives and similar repositories for skynet-ddp-slurm-example

Users that are interested in skynet-ddp-slurm-example are comparing it to the libraries listed below

• cjrd / selfaugment
  Code for SelfAugment
  ☆27Updated 4 years ago
• csrhddlam / pytorch-checkpoint
  ☆165Updated 6 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 3 years ago
• ag14774 / diffdist
  ☆62Updated 4 years ago
• vfdev-5 / UDA-pytorch
  Unsupervised Data Augmentation experiments in PyTorch
  ☆59Updated 5 years ago
• ankandrew / online-label-smoothing-pt
  Implementation of Online Label Smoothing in PyTorch
  ☆94Updated 2 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆46Updated 5 years ago
• hrayrhar / limit-label-memorization
  Improving generalization by controlling label-noise information in neural network weights.
  ☆40Updated 4 years ago
• eladhoffer / fix_your_classifier
  ☆34Updated 6 years ago
• lucidrains / long-short-transformer
  Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
  ☆119Updated 3 years ago
• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆88Updated 4 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆87Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated 10 months ago
• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 4 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• ronghanghu / moco_v3_tpu
  ☆16Updated 3 years ago
• yk / PyTorch_CIFAR10
  Pretrained TorchVision models on CIFAR10 dataset (with weights)
  ☆24Updated 4 years ago
• jramapuram / BYOL
  Bootstrap Your Own Latent (BYOL) pytorch implementation using DistributedDataParallel.
  ☆28Updated 2 years ago
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆73Updated 4 years ago
• LAION-AI / Big-Interleaved-Dataset
  Big-Interleaved-Dataset
  ☆57Updated 2 years ago
• songweige / Contrastive-Learning-with-Non-Semantic-Negatives
  Robust Contrastive Learning Using Negative Samples with Diminished Semantics (NeurIPS 2021)
  ☆39Updated 3 years ago
• vcl-iisc / ZSKD
  Zero-Shot Knowledge Distillation in Deep Networks
  ☆67Updated 3 years ago
• vacancy / AdvancedIndexing-PyTorch
  (Batched) advanced indexing for PyTorch.
  ☆53Updated 5 months ago
• fiveai / making-better-mistakes
  ☆66Updated 3 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆74Updated 7 years ago
• tmbdev-archive / webdataset-lightning
  A small demonstration of using WebDataset with ImageNet and PyTorch Lightning
  ☆74Updated last year
• yukimasano / linear-probes
  Evaluating AlexNet features at various depths
  ☆39Updated 4 years ago
• taoyang1122 / GradAug
  [NeurIPS'20] GradAug: A New Regularization Method for Deep Neural Networks
  ☆94Updated 4 years ago