erikwijmans / skynet-ddp-slurm-example

Related projects ⓘ

Alternatives and complementary repositories for skynet-ddp-slurm-example

• izmailovpavel / torch_swa_examples
  ☆47Updated 3 years ago
• cjrd / selfaugment
  Code for SelfAugment
  ☆27Updated 3 years ago
• csrhddlam / pytorch-checkpoint
  ☆165Updated 5 years ago
• ag14774 / diffdist
  ☆61Updated 4 years ago
• ronghanghu / moco_v3_tpu
  ☆16Updated 2 years ago
• moskomule / shampoo.pytorch
  An implementation of shampoo
  ☆74Updated 6 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆86Updated 3 years ago
• ShigekiKarita / pytorch-distributed-slurm-example
  ☆42Updated 5 years ago
• jramapuram / BYOL
  Bootstrap Your Own Latent (BYOL) pytorch implementation using DistributedDataParallel.
  ☆28Updated last year
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆62Updated 3 months ago
• eladhoffer / fix_your_classifier
  ☆34Updated 5 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆119Updated 3 years ago
• eladhoffer / utils.pytorch
  Utilities for Pytorch
  ☆89Updated 2 years ago
• songweige / Contrastive-Learning-with-Non-Semantic-Negatives
  Robust Contrastive Learning Using Negative Samples with Diminished Semantics (NeurIPS 2021)
  ☆39Updated 2 years ago
• yukimasano / linear-probes
  Evaluating AlexNet features at various depths
  ☆39Updated 4 years ago
• tbung / pytorch-revnet
  Implementation of the reversible residual network in pytorch
  ☆101Updated 2 years ago
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆72Updated 3 years ago
• li-js / gpu_memory_profiling
  Profile the GPU memory usage of every line in a Pytorch code
  ☆82Updated 6 years ago
• ankandrew / online-label-smoothing-pt
  Implementation of Online Label Smoothing in PyTorch
  ☆94Updated 2 years ago
• lucidrains / memformer
  Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
  ☆106Updated 4 years ago
• ItzikMalkiel / MTAdam
  MTAdam: Automatic Balancing of Multiple Training Loss Terms
  ☆36Updated 4 years ago
• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆46Updated 4 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆66Updated last year
• hukkai / rescaling
  [NeurIPS 2020 Oral] Is normalization indispensable for training deep neural networks?
  ☆34Updated 2 years ago
• tonylins / simclr-converter
  A PyTorch converter for SimCLR checkpoints
  ☆106Updated 3 years ago
• apple / ml-data-parameters
  ☆74Updated 2 years ago
• Separius / CudaRelativeAttention
  custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
  ☆43Updated 4 years ago
• janfreyberg / pytorch-revgrad
  A minimal pytorch package implementing a gradient reversal layer.
  ☆156Updated 2 weeks ago
• lucidrains / long-short-transformer
  Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
  ☆116Updated 3 years ago
• facebookresearch / GDT
  We present a framework for training multi-modal deep learning models on unlabelled video data by forcing the network to learn invariances…
  ☆45Updated 3 years ago