Alternatives and similar repositories for Transformer:

Users that are interested in Transformer are comparing it to the libraries listed below

• kimiyoung / transformer-xl
  ☆3,635Updated 2 years ago
• jayparks / transformer
  A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"
  ☆551Updated 4 years ago
• lucidrains / reformer-pytorch
  Reformer, the efficient Transformer, in Pytorch
  ☆2,152Updated last year
• keon / seq2seq
  Minimal Seq2Seq model with Attention for Neural Machine Translation in PyTorch
  ☆695Updated 4 years ago
• Kyubyong / transformer
  A TensorFlow Implementation of the Transformer: Attention Is All You Need
  ☆4,328Updated last year
• bentrevett / pytorch-seq2seq
  Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
  ☆5,466Updated last year
• jadore801120 / attention-is-all-you-need-pytorch
  A PyTorch implementation of the Transformer model in "Attention is All You Need".
  ☆9,019Updated 10 months ago
• allenai / longformer
  Longformer: The Long-Document Transformer
  ☆2,082Updated 2 years ago
• tunz / transformer-pytorch
  Transformer implementation in PyTorch.
  ☆479Updated 5 years ago
• IBM / pytorch-seq2seq
  An open source framework for seq2seq models in PyTorch.
  ☆1,506Updated 2 years ago
• idiap / fast-transformers
  Pytorch library for fast transformer implementations
  ☆1,679Updated last year
• codertimo / BERT-pytorch
  Google AI 2018 BERT pytorch implementation
  ☆6,300Updated last year
• rsennrich / subword-nmt
  Unsupervised Word Segmentation for Neural Machine Translation and Text Generation
  ☆2,218Updated 6 months ago
• harvardnlp / annotated-transformer
  An annotated implementation of the Transformer paper.
  ☆6,000Updated 10 months ago
• hyunwoongko / transformer
  Transformer: PyTorch Implementation of "Attention Is All You Need"
  ☆3,361Updated 6 months ago
• huggingface / pytorch-openai-transformer-lm
  🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI
  ☆1,508Updated 3 years ago
• jessevig / bertviz
  BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
  ☆7,137Updated last year
• facebookresearch / XLM
  PyTorch original implementation of Cross-lingual Language Model Pretraining.
  ☆2,900Updated 2 years ago
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,550Updated 4 years ago
• pbloem / former
  Simple transformer implementation from scratch in pytorch.
  ☆1,076Updated 9 months ago
• lsdefine / attention-is-all-you-need-keras
  A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need
  ☆713Updated 3 years ago
• dhlee347 / pytorchic-bert
  Pytorch Implementation of Google BERT
  ☆593Updated 4 years ago
• openai / finetune-transformer-lm
  Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
  ☆2,189Updated 6 years ago
• princeton-nlp / SimCSE
  [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
  ☆3,502Updated 4 months ago
• salesforce / awd-lstm-lm
  LSTM and QRNN Language Model Toolkit for PyTorch
  ☆1,965Updated 3 years ago
• microsoft / MASS
  MASS: Masked Sequence to Sequence Pre-training for Language Generation
  ☆1,118Updated 2 years ago
• OpenNMT / OpenNMT-py
  Open Source Neural Machine Translation and (Large) Language Models in PyTorch
  ☆6,827Updated last month
• epfml / attention-cnn
  Source code for "On the Relationship between Self-Attention and Convolutional Layers"
  ☆1,096Updated 2 years ago
• bojone / attention
  some attention implements
  ☆1,440Updated 5 years ago
• lilianweng / transformer-tensorflow
  Implementation of Transformer Model in Tensorflow
  ☆466Updated last year