Alternatives and similar repositories for adaptive-span:

Users that are interested in adaptive-span are comparing it to the libraries listed below

• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,112Updated 3 years ago
• mit-han-lab / lite-transformer
  [ICLR 2020] Lite Transformer with Long-Short Range Attention
  ☆607Updated 9 months ago
• Smerity / sha-rnn
  Single Headed Attention RNN - "Stop thinking with your head"
  ☆1,183Updated 3 years ago
• andreamad8 / Universal-Transformer-Pytorch
  Implementation of Universal Transformer in Pytorch
  ☆259Updated 6 years ago
• asyml / texar-pytorch
  Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CAS…
  ☆745Updated 3 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆329Updated 2 years ago
• tatp22 / linformer-pytorch
  My take on a practical implementation of Linformer for Pytorch.
  ☆413Updated 2 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆291Updated 3 years ago
• alexa / bort
  Repository for the paper "Optimal Subarchitecture Extraction for BERT"
  ☆472Updated 2 years ago
• huggingface / hmtl
  🌊HMTL: Hierarchical Multi-Task Learning - A State-of-the-Art neural network model for several NLP tasks based on PyTorch and AllenNLP
  ☆1,194Updated last year
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,569Updated 4 years ago
• deep-spin / entmax
  The entmax mapping and its loss, a family of sparse softmax alternatives.
  ☆432Updated 10 months ago
• harvardnlp / var-attn
  Latent Alignment and Variational Attention
  ☆327Updated 6 years ago
• zihangdai / mos
  ☆394Updated 6 years ago
• laiguokun / Funnel-Transformer
  ☆218Updated 4 years ago
• cybertronai / pytorch-lamb
  Implementation of https://arxiv.org/abs/1904.00962
  ☆374Updated 4 years ago
• sacmehta / delight
  DeLighT: Very Deep and Light-Weight Transformers
  ☆467Updated 4 years ago
• microsoft / fastformers
  FastFormers - highly efficient transformer models for NLU
  ☆706Updated last month
• yikangshen / Ordered-Neurons
  Code for the paper "Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks"
  ☆578Updated 5 years ago
• locuslab / trellisnet
  [ICLR'19] Trellis Networks for Sequence Modeling
  ☆472Updated 5 years ago
• Maluuba / gensen
  Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning
  ☆311Updated 4 years ago
• elbayadm / attn2d
  Pervasive Attention: 2D Convolutional Networks for Sequence-to-Sequence Prediction
  ☆502Updated 3 years ago
• graykode / xlnet-Pytorch
  Simple XLNet implementation with Pytorch Wrapper
  ☆582Updated 5 years ago
• eladhoffer / seq2seq.pytorch
  Sequence-to-Sequence learning using PyTorch
  ☆522Updated 5 years ago
• lucidrains / sinkhorn-transformer
  Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention
  ☆262Updated 3 years ago
• majumderb / rezero
  Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆407Updated 9 months ago
• facebookresearch / unlikelihood_training
  Neural Text Generation with Unlikelihood Training
  ☆309Updated 3 years ago
• guolinke / TUPE
  Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…
  ☆251Updated 3 years ago
• allenai / writing-code-for-nlp-research-emnlp2018
  A companion repository for the "Writing code for NLP Research" Tutorial at EMNLP 2018
  ☆555Updated 6 years ago
• microsoft / MASS
  MASS: Masked Sequence to Sequence Pre-training for Language Generation
  ☆1,119Updated 2 years ago