Alternatives and similar repositories for skynet-ddp-slurm-example:

Users that are interested in skynet-ddp-slurm-example are comparing it to the libraries listed below

• ag14774 / diffdist
  ☆62Updated 4 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆119Updated 3 years ago
• cjrd / selfaugment
  Code for SelfAugment
  ☆27Updated 4 years ago
• lichengunc / pretrain-vl-data
  Pre-trained V+L Data Preparation
  ☆46Updated 4 years ago
• eladhoffer / fix_your_classifier
  ☆34Updated 6 years ago
• lucidrains / long-short-transformer
  Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
  ☆118Updated 3 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆74Updated 7 years ago
• csrhddlam / pytorch-checkpoint
  ☆165Updated 6 years ago
• LAION-AI / Big-Interleaved-Dataset
  Big-Interleaved-Dataset
  ☆58Updated 2 years ago
• intersun / LightningDOT
  source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
  ☆72Updated 2 years ago
• lucidrains / memformer
  Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
  ☆115Updated 4 years ago
• princeton-vl / selfstudy
  Code for reproducing experiments in "How Useful is Self-Supervised Pretraining for Visual Tasks?"
  ☆60Updated 9 months ago
• gnouhp / PyTorch-AdaHAN
  An unofficial PyTorch implementation of the HAN and AdaHAN models presented in the "Learning Visual Question Answering by Bootstrapping H…
  ☆54Updated 6 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• ronghanghu / moco_v3_tpu
  ☆16Updated 3 years ago
• vfdev-5 / UDA-pytorch
  Unsupervised Data Augmentation experiments in PyTorch
  ☆59Updated 5 years ago
• janfreyberg / pytorch-revgrad
  A minimal pytorch package implementing a gradient reversal layer.
  ☆158Updated 5 months ago
• zhegan27 / VILLA
  Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…
  ☆119Updated 4 years ago
• ronghanghu / gqa_single_hop_baseline
  A simple but well-performing "single-hop" visual attention model for the GQA dataset
  ☆20Updated 5 years ago
• MicPie / clasp
  CLASP - Contrastive Language-Aminoacid Sequence Pretraining
  ☆142Updated 3 years ago
• MAC-AutoML / YOCO-BERT
  The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…
  ☆48Updated 3 years ago
• berniebear / Multi-HT100M
  ☆53Updated 3 years ago
• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆88Updated 4 years ago
• apple / ml-data-parameters
  ☆76Updated 2 years ago
• ischlag / fast-weight-transformers
  Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.
  ☆104Updated 3 years ago
• demelin / Noise-Contrastive-Estimation-NCE-for-pyTorch
  Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…
  ☆45Updated 5 years ago
• lucidrains / g-mlp-gpt
  GPT, but made only out of MLPs
  ☆88Updated 3 years ago
• ryanleary / ctcdecode
  PyTorch CTC Decoder bindings
  ☆42Updated 7 years ago
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆73Updated 4 years ago
• airsplay / vimpac
  ☆73Updated 2 years ago