Alternatives and similar repositories for AdaptBatch

Users that are interested in AdaptBatch are comparing it to the libraries listed below

• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆102Updated 5 years ago
• htoyryla / DALLE-pytorch
  Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
  ☆59Updated 5 years ago
• Rick-McCoy / Reformer-pytorch
  Implements Reformer: The Efficient Transformer in pytorch.
  ☆86Updated 5 years ago
• harvardnlp / cascaded-generation
  Cascaded Text Generation with Markov Transformers
  ☆130Updated 2 years ago
• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆89Updated 5 years ago
• Enealor / PyTorch-SM3
  Implements the SM3-II adaptive optimization algorithm for PyTorch.
  ☆33Updated last year
• laiguokun / Funnel-Transformer
  ☆221Updated 5 years ago
• tnq177 / transformers_without_tears
  Transformers without Tears: Improving the Normalization of Self-Attention
  ☆134Updated last year
• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 5 years ago
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆118Updated 4 years ago
• nng555 / ssmba
  ☆62Updated 3 years ago
• rosinality / adaptive-softmax-pytorch
  Adaptive Softmax implementation for PyTorch
  ☆81Updated 6 years ago
• giannisdaras / smyrf
  [NeurIPS 2020] Official Implementation: "SMYRF: Efficient Attention using Asymmetric Clustering".
  ☆50Updated 2 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆84Updated 11 months ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 3 years ago
• LeviViana / torch_sampling
  Efficient reservoir sampling implementation for PyTorch
  ☆107Updated 4 years ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 5 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 3 years ago
• waitwaitforget / modelparallel_pytorch
  Model Parallelism for pytorch training multiple network on multiple GPUs.
  ☆28Updated 7 years ago
• hendrycks / GELUs
  A smoother activation function (undergrad code)
  ☆116Updated 5 years ago
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 4 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆109Updated 3 years ago
• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆270Updated 4 years ago
• princeton-nlp / DataMUX
  [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks
  ☆60Updated 3 years ago
• kaushalshetty / Positional-Encoding
  Encoding position with the word embeddings.
  ☆84Updated 7 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 4 years ago
• epfml / collaborative-attention
  Code for Multi-Head Attention: Collaborate Instead of Concatenate
  ☆153Updated 2 years ago
• ClashLuke / PerfTorch
  High performance pytorch modules
  ☆18Updated 3 years ago
• TimDettmers / transformer-xl
  ☆65Updated 5 years ago