Alternatives and similar repositories for Transformer_Relative_Position_PyTorch

Users that are interested in Transformer_Relative_Position_PyTorch are comparing it to the libraries listed below

• lucidrains / FLASH-pytorch
  Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
  ☆364Updated last year
• OpenNLPLab / cosFormer
  [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
  ☆193Updated 2 years ago
• fangleai / TransformerCVAE
  Transformer-based Conditional Variational Autoencoder for Controllable Story Generation
  ☆156Updated 3 years ago
• xuanqing94 / FLOATER
  Learning to Encode Position for Transformer with Continuous Dynamical Model
  ☆60Updated 4 years ago
• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆152Updated 6 years ago
• TensorUI / relative-position-pytorch
  a pytorch implementation of self-attention with relative position representations
  ☆50Updated 4 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆123Updated last year
• dashstander / block-recurrent-transformer
  Pytorch implementation of "Block Recurrent Transformers" (Hutchins & Schlag et al., 2022)
  ☆84Updated 3 years ago
• guolinke / TUPE
  Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…
  ☆251Updated 3 years ago
• lancopku / Explicit-Sparse-Transformer
  code for Explicit Sparse Transformer
  ☆62Updated last year
• Hzfinfdu / Diffusion-BERT
  ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
  ☆309Updated last year
• lucidrains / linformer
  Implementation of Linformer for Pytorch
  ☆288Updated last year
• thu-coai / DA-Transformer
  Official Implementation for the ICML2022 paper "Directed Acyclic Transformer for Non-Autoregressive Machine Translation"
  ☆125Updated last year
• lucidrains / local-attention
  An implementation of local windowed attention for language modeling
  ☆454Updated 5 months ago
• huanghonggit / Mask-Language-Model
  pytorch； mask language model ； bert
  ☆72Updated 5 years ago
• OpenVLG / DELLA
  Official code for the NAACL 2022 paper "Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text…
  ☆35Updated 2 years ago
• tatp22 / linformer-pytorch
  My take on a practical implementation of Linformer for Pytorch.
  ☆414Updated 2 years ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆98Updated 2 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆295Updated 3 years ago
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆40Updated 3 years ago
• 1140310118 / tdlm
  实现了Transformer中的几种位置编码方案
  ☆44Updated 3 years ago
• lzy1732008 / GaussionTransformer
  For paper《Gaussian Transformer: A Lightweight Approach for Natural Language Inference》
  ☆28Updated 5 years ago
• Yuanhy1997 / SeqDiffuSeq
  Text Diffusion Model with Encoder-Decoder Transformers for Sequence-to-Sequence Generation [NAACL 2024]
  ☆96Updated last year
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆189Updated 2 years ago
• YRdddream / attattr
  ☆89Updated 2 years ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 3 years ago
• HKUNLP / reparam-discrete-diffusion
  Reparameterized Discrete Diffusion Models for Text Generation
  ☆99Updated 2 years ago
• twistedcubic / attention-rank-collapse
  [ICML 2021 Oral] We show pure attention suffers rank collapse, and how different mechanisms combat it.
  ☆165Updated 4 years ago
• bojone / rnn
  一些RNN的实现
  ☆50Updated 2 years ago
• leaderj1001 / Synthesizer-Rethinking-Self-Attention-Transformer-Models
  Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
  ☆70Updated 5 years ago