Alternatives and similar repositories for AdaptBatch

Users that are interested in AdaptBatch are comparing it to the libraries listed below

• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆102Updated 5 years ago
• htoyryla / DALLE-pytorch
  Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
  ☆59Updated 4 years ago
• Enealor / PyTorch-SM3
  Implements the SM3-II adaptive optimization algorithm for PyTorch.
  ☆33Updated last year
• Rick-McCoy / Reformer-pytorch
  Implements Reformer: The Efficient Transformer in pytorch.
  ☆86Updated 5 years ago
• iKernels / transformers-lightning
  A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transfor…
  ☆47Updated 2 years ago
• harvardnlp / cascaded-generation
  Cascaded Text Generation with Markov Transformers
  ☆129Updated 2 years ago
• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆89Updated 4 years ago
• ClashLuke / PerfTorch
  High performance pytorch modules
  ☆18Updated 2 years ago
• rosinality / adaptive-softmax-pytorch
  Adaptive Softmax implementation for PyTorch
  ☆81Updated 6 years ago
• lucidrains / hamburger-pytorch
  Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"
  ☆99Updated 4 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆108Updated 4 years ago
• waitwaitforget / modelparallel_pytorch
  Model Parallelism for pytorch training multiple network on multiple GPUs.
  ☆28Updated 7 years ago
• giannisdaras / smyrf
  [NeurIPS 2020] Official Implementation: "SMYRF: Efficient Attention using Asymmetric Clustering".
  ☆50Updated 2 years ago
• nng555 / ssmba
  ☆62Updated 3 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 3 years ago
• laiguokun / Funnel-Transformer
  ☆220Updated 5 years ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 4 years ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆41Updated 4 years ago
• cpcp1998 / PermuteFormer
  Code for the paper PermuteFormer
  ☆42Updated 4 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆49Updated 3 years ago
• princeton-nlp / DataMUX
  [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks
  ☆60Updated 3 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 3 years ago
• lucidrains / n-grammer-pytorch
  Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
  ☆76Updated 3 years ago
• tnq177 / transformers_without_tears
  Transformers without Tears: Improving the Normalization of Self-Attention
  ☆134Updated last year
• ildoonet / remote-dataloader
  PyTorch DataLoader processed in multiple remote computation machines for heavy data processings
  ☆68Updated 6 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆57Updated 5 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆84Updated 10 months ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆109Updated 2 years ago
• lucidrains / g-mlp-gpt
  GPT, but made only out of MLPs
  ☆89Updated 4 years ago