Alternatives and similar repositories for pytorch-ddp:

Users that are interested in pytorch-ddp are comparing it to the libraries listed below

• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆37Updated 3 years ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆71Updated last year
• CyndxAI / QKNorm
  Code for the paper "Query-Key Normalization for Transformers"
  ☆39Updated 4 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆51Updated 2 years ago
• schwartz-lab-NLP / papa
  Code for the PAPA paper
  ☆27Updated 2 years ago
• vrvlive / knowlege-distillation
  PyTorch, PyTorch Lightning framework for trying knowledge distillation in image classification problems
  ☆32Updated 9 months ago
• LAION-AI / Conditional-Pretraining-of-Large-Language-Models
  ☆37Updated last year
• lucidrains / rela-transformer
  Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012
  ☆49Updated 3 years ago
• lucidrains / learning-to-expire-pytorch
  An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
  ☆33Updated 4 years ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆53Updated last year
• hoya012 / swa-tutorials-pytorch
  Stochastic Weight Averaging Tutorials using pytorch.
  ☆33Updated 4 years ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆50Updated 6 months ago
• sarthmit / Mod_Arch
  ☆33Updated last year
• stanislavfort / adversaries_to_convnext
  Adversarial examples to the new ConvNeXt architecture
  ☆20Updated 3 years ago
• rasbt / cvpr2023
  ☆133Updated last year
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆85Updated 2 years ago
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆45Updated 2 years ago
• HazyResearch / prefix-linear-attention
  ☆53Updated 9 months ago
• google-research / head2toe
  ☆81Updated 8 months ago
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆49Updated last year
• fattorib / Flax-ResNets
  CIFAR10 ResNets implemented in JAX+Flax
  ☆12Updated 3 years ago
• AntNLP / nope_head_scale
  ☆23Updated 11 months ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆45Updated 4 years ago
• conceptofmind / t5-pytorch
  Implementation of Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer in PyTorch.
  ☆51Updated last year
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• cheneydon / efficient-bert
  This repository contains the code for the paper in Findings of EMNLP 2021: "EfficientBERT: Progressively Searching Multilayer Perceptron …
  ☆32Updated last year
• CMU-MultiComp-Lab / mmml-tutorial
  ☆28Updated last year
• krafton-ai / mambaformer-icl
  MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248
  ☆51Updated 10 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆12Updated 2 months ago
• srush / mamba-primer
  ☆37Updated last year