evelinehong / Transformer_Relative_Position_PyTorch

Related projects: ⓘ

• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆146Updated 5 years ago
• lucidrains / FLASH-pytorch
  Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
  ☆345Updated 11 months ago
• xuanqing94 / FLOATER
  Learning to Encode Position for Transformer with Continuous Dynamical Model
  ☆59Updated 4 years ago
• TensorUI / relative-position-pytorch
  a pytorch implementation of self-attention with relative position representations
  ☆51Updated 3 years ago
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆184Updated last year
• fangleai / TransformerCVAE
  Transformer-based Conditional Variational Autoencoder for Controllable Story Generation
  ☆145Updated 2 years ago
• OpenNLPLab / cosFormer
  [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
  ☆178Updated last year
• FreedomIntelligence / complex-order
  ☆83Updated 4 years ago
• lucidrains / linformer
  Implementation of Linformer for Pytorch
  ☆244Updated 8 months ago
• huanghonggit / Mask-Language-Model
  pytorch； mask language model ； bert
  ☆69Updated 4 years ago
• guocheng18 / Transformer-Encoder
  Implementation of Transformer encoder in PyTorch
  ☆57Updated 4 years ago
• leaderj1001 / Synthesizer-Rethinking-Self-Attention-Transformer-Models
  Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
  ☆70Updated 4 years ago
• lancopku / Explicit-Sparse-Transformer
  code for Explicit Sparse Transformer
  ☆57Updated last year
• budzianowski / PyTorch-Beam-Search-Decoding
  PyTorch implementation of beam search decoding for seq2seq models
  ☆333Updated last year
• guolinke / TUPE
  Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…
  ☆249Updated 2 years ago
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆39Updated 3 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆111Updated 6 months ago
• lzy1732008 / GaussionTransformer
  For paper《Gaussian Transformer: A Lightweight Approach for Natural Language Inference》
  ☆27Updated 4 years ago
• dashstander / block-recurrent-transformer
  Pytorch implementation of "Block Recurrent Transformers" (Hutchins & Schlag et al., 2022)
  ☆83Updated 2 years ago
• Hzfinfdu / Diffusion-BERT
  ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
  ☆286Updated 7 months ago
• Eathoublu / attention-is-all-you-need-pytorch
  A PyTorch implementation of the Transformer model in "Attention is All You Need".
  ☆19Updated 6 years ago
• dreamgonfly / transformer-pytorch
  A PyTorch implementation of Transformer in "Attention is All You Need"
  ☆103Updated 3 years ago
• raminnakhli / Decoupled-Contrastive-Learning
  This repository is an implementation for the loss function proposed in https://arxiv.org/pdf/2110.06848.pdf.
  ☆107Updated 2 years ago
• RElbers / info-nce-pytorch
  PyTorch implementation of the InfoNCE loss for self-supervised learning.
  ☆464Updated 10 months ago
• thu-coai / DA-Transformer
  Official Implementation for the ICML2022 paper "Directed Acyclic Transformer for Non-Autoregressive Machine Translation"
  ☆119Updated last year
• lucidrains / local-attention
  An implementation of local windowed attention for language modeling
  ☆370Updated last week
• dropreg / R-Drop
  ☆866Updated 3 months ago
• guangyliu / LatentOps
  Source code of LatentOps
  ☆77Updated 10 months ago
• jongwooko / Pytorch-MiniLM
  Unofficial Pytorch implementation of MiniLM and MiniLMv2
  ☆19Updated 2 years ago
• cloneofsimo / realformer-pytorch
  Implementation of RealFormer using pytorch
  ☆102Updated 3 years ago