Alternatives and similar repositories for skynet-ddp-slurm-example

Users that are interested in skynet-ddp-slurm-example are comparing it to the libraries listed below

• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• ag14774 / diffdist
  ☆62Updated 5 years ago
• csrhddlam / pytorch-checkpoint
  ☆165Updated 7 years ago
• google-research / reassessed-imagenet
  Labels and other data for the paper "Are we done with ImageNet?"
  ☆199Updated 4 years ago
• ShigekiKarita / pytorch-distributed-slurm-example
  ☆43Updated 6 years ago
• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆89Updated 4 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆377Updated 5 years ago
• hongyi-zhang / Fixup
  A Re-implementation of Fixed-update Initialization
  ☆155Updated 6 years ago
• KrisKorrel / sparsemax-pytorch
  Implementation of Sparsemax activation in Pytorch
  ☆166Updated 5 years ago
• LAION-AI / Big-Interleaved-Dataset
  Big-Interleaved-Dataset
  ☆58Updated 2 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆87Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated last year
• li-js / gpu_memory_profiling
  Profile the GPU memory usage of every line in a Pytorch code
  ☆83Updated 7 years ago
• ronghanghu / moco_v3_tpu
  ☆16Updated 3 years ago
• epfml / collaborative-attention
  Code for Multi-Head Attention: Collaborate Instead of Concatenate
  ☆153Updated 2 years ago
• tonylins / simclr-converter
  A PyTorch converter for SimCLR checkpoints
  ☆108Updated 4 years ago
• janfreyberg / pytorch-revgrad
  A minimal pytorch package implementing a gradient reversal layer.
  ☆158Updated last year
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆78Updated 7 years ago
• cjrd / selfaugment
  Code for SelfAugment
  ☆27Updated 5 years ago
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆74Updated 4 years ago
• facebookresearch / data2vec_vision
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆80Updated 3 years ago
• tbung / pytorch-revnet
  Implementation of the reversible residual network in pytorch
  ☆106Updated 3 years ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 4 years ago
• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆46Updated 6 years ago
• MicPie / clasp
  CLASP - Contrastive Language-Aminoacid Sequence Pretraining
  ☆143Updated 4 years ago
• noameshed / novelty-detection
  Analyzing basic network responses to novel classes
  ☆41Updated 4 years ago
• tmbdev-archive / webdataset-lightning
  A small demonstration of using WebDataset with ImageNet and PyTorch Lightning
  ☆75Updated 2 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆299Updated 4 years ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆228Updated 3 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 3 years ago