Alternatives and similar repositories for transformers

Users that are interested in transformers are comparing it to the libraries listed below

• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 4 years ago
• lyeoni / pretraining-for-language-understanding
  Pre-training of Language Models for Language Understanding
  ☆83Updated 6 years ago
• Kyubyong / lm_finetuning
  Language Model Fine-tuning for Moby Dick
  ☆42Updated 6 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆137Updated 6 years ago
• gsarti / lambda-bert
  A 🤗-style implementation of BERT using lambda layers instead of self-attention
  ☆69Updated 5 years ago
• huggingface / datasets-viewer
  Viewer for the 🤗 datasets library.
  ☆86Updated 4 years ago
• CurationCorp / curation-corpus
  Code for obtaining the Curation Corpus abstractive text summarisation dataset
  ☆127Updated 5 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆159Updated 6 years ago
• clovaai / subword-qac
  Subword Language Model for Query Auto-Completion
  ☆67Updated 6 years ago
• prajjwal1 / fluence
  A deep learning library based on Pytorch focussed on low resource language research and robustness
  ☆70Updated 4 years ago
• hsha0 / electra
  ELECTRA MODEL NLP
  ☆13Updated 5 years ago
• cgraywang / transformer-on-diet
  Code repo for "Transformer on a Diet" paper
  ☆31Updated 5 years ago
• Georgetown-IR-Lab / ExtendedSumm
  On Generating Extended Summaries of Long Documents
  ☆78Updated 4 years ago
• AndreasMadsen / python-textualheatmap
  Create interactive textual heat maps for Jupiter notebooks
  ☆196Updated last year
• TimDettmers / transformer-xl
  ☆65Updated 5 years ago
• cybertronai / transformer-xl
  Training Transformer-XL on 128 GPUs
  ☆141Updated 5 years ago
• wangcongcong123 / ttt
  A package for fine-tuning Transformers with TPUs, written in Tensorflow2.0+
  ☆37Updated 4 years ago
• ashokc / Bow-to-Bert
  Evolution of word vectors from long, sparse, and 1-hot to short, dense, and context sensitive
  ☆28Updated 2 years ago
• yk / huggingface-nlp-demo
  ☆46Updated 5 years ago
• DomHudson / bert-in-production
  A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.
  ☆96Updated 4 years ago
• jeongukjae / pytorch-bert
  An implementation of BERT using PyTorch's TransformerEncoder
  ☆33Updated 5 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆137Updated 2 years ago
• SeanNaren / CORD-19-ANN
  ANN Search through the COVID CORD-19 Dataset using SBERT.
  ☆26Updated 5 years ago
• erwtokritos / keras-glove
  Implementation of GloVe in Keras
  ☆45Updated 2 years ago
• patil-suraj / onnx_transformers
  Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.
  ☆127Updated 5 years ago
• sgraaf / Replicate-Toronto-BookCorpus
  This repository contains code to replicate the no-longer publicly available Toronto BookCorpus dataset
  ☆49Updated 3 years ago
• archsyscall / aquvitae
  Knowledge Distillation Toolkit
  ☆88Updated 5 years ago
• shoarora / transformers-trainers
  Tools for training pytorch language models
  ☆27Updated 5 years ago
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated last year
• babylonhealth / fuzzymax
  Code for the paper: Don't Settle for Average, Go for the Max: Fuzzy Sets and Max-Pooled Word Vectors, ICLR 2019.
  ☆43Updated 3 years ago