Alternatives and similar repositories for transformers

Users that are interested in transformers are comparing it to the libraries listed below

• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 4 years ago
• gsarti / lambda-bert
  A 🤗-style implementation of BERT using lambda layers instead of self-attention
  ☆69Updated 5 years ago
• lyeoni / pretraining-for-language-understanding
  Pre-training of Language Models for Language Understanding
  ☆83Updated 6 years ago
• CurationCorp / curation-corpus
  Code for obtaining the Curation Corpus abstractive text summarisation dataset
  ☆128Updated 5 years ago
• Kyubyong / lm_finetuning
  Language Model Fine-tuning for Moby Dick
  ☆42Updated 6 years ago
• huggingface / datasets-viewer
  Viewer for the 🤗 datasets library.
  ☆86Updated 4 years ago
• Georgetown-IR-Lab / ExtendedSumm
  On Generating Extended Summaries of Long Documents
  ☆78Updated 5 years ago
• cgraywang / transformer-on-diet
  Code repo for "Transformer on a Diet" paper
  ☆31Updated 5 years ago
• TimDettmers / transformer-xl
  ☆65Updated 5 years ago
• babylonhealth / fuzzymax
  Code for the paper: Don't Settle for Average, Go for the Max: Fuzzy Sets and Max-Pooled Word Vectors, ICLR 2019.
  ☆43Updated 3 years ago
• SeanNaren / CORD-19-ANN
  ANN Search through the COVID CORD-19 Dataset using SBERT.
  ☆26Updated 5 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆137Updated 6 years ago
• yk / huggingface-nlp-demo
  ☆46Updated 5 years ago
• hsha0 / electra
  ELECTRA MODEL NLP
  ☆13Updated 5 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆159Updated 6 years ago
• gnes-ai / hub
  GNES Hub ship AI/ML models as Docker containers and use Docker containers as plugins.
  ☆34Updated 6 years ago
• wangcongcong123 / ttt
  A package for fine-tuning Transformers with TPUs, written in Tensorflow2.0+
  ☆37Updated 4 years ago
• sgraaf / Replicate-Toronto-BookCorpus
  This repository contains code to replicate the no-longer publicly available Toronto BookCorpus dataset
  ☆49Updated 3 years ago
• ashokc / Bow-to-Bert
  Evolution of word vectors from long, sparse, and 1-hot to short, dense, and context sensitive
  ☆28Updated 2 years ago
• cybertronai / transformer-xl
  Training Transformer-XL on 128 GPUs
  ☆141Updated 5 years ago
• zbloss / TransformerModel
  ☆58Updated 6 years ago
• prajjwal1 / fluence
  A deep learning library based on Pytorch focussed on low resource language research and robustness
  ☆70Updated 4 years ago
• briandw / SiameseULMFiT
  ULMFiT + Siamese Network for Sentence Vectors
  ☆33Updated 7 years ago
• DomHudson / bert-in-production
  A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.
  ☆96Updated 4 years ago
• shoarora / transformers-trainers
  Tools for training pytorch language models
  ☆27Updated 5 years ago
• microsoft / Distilled-Sentence-Embedding
  Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation
  ☆34Updated 2 years ago
• r0mainK / outperformer
  Code for scaling Transformers
  ☆26Updated 5 years ago
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated last year
• prajjwal1 / language-modelling
  LM, ULMFit et al.
  ☆46Updated 6 years ago
• kaushalshetty / Positional-Encoding
  Encoding position with the word embeddings.
  ☆84Updated 7 years ago