Alternatives and similar repositories for electra-pytorch

Users that are interested in electra-pytorch are comparing it to the libraries listed below

• richarddwang / electra_pytorch
  Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
  ☆330Updated last year
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆179Updated 2 years ago
• bloodwass / mixout
  Implementation of Mixout with PyTorch
  ☆75Updated 2 years ago
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 4 years ago
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆118Updated 4 years ago
• archinetai / smart-pytorch
  PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.
  ☆62Updated 3 years ago
• laiguokun / Funnel-Transformer
  ☆219Updated 5 years ago
• voidism / DiffCSE
  Code for the NAACL 2022 long paper "DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings"
  ☆296Updated 2 years ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆113Updated 2 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 4 years ago
• lucidrains / marge-pytorch
  Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
  ☆76Updated 4 years ago
• IntelLabs / academic-budget-bert
  Repository containing code for "How to Train BERT with an Academic Budget" paper
  ☆314Updated last year
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆330Updated 3 years ago
• helboukkouri / character-bert
  Main repository for "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"
  ☆201Updated last year
• rrmenon10 / ADAPET
  [EMNLP 2021] Improving and Simplifying Pattern Exploiting Training
  ☆153Updated 3 years ago
• allenai / cartography
  Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics
  ☆204Updated 3 years ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆156Updated last year
• gsarti / lambda-bert
  A 🤗-style implementation of BERT using lambda layers instead of self-attention
  ☆69Updated 4 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆137Updated 2 years ago
• JohnGiorgi / DeCLUTR
  The corresponding code from our paper "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations". Do not hesitate to o…
  ☆380Updated 2 years ago
• salesforce / GeDi
  GeDi: Generative Discriminator Guided Sequence Generation
  ☆211Updated 2 months ago
• ricardorei / lightning-text-classification
  Minimalist implementation of a BERT Sentence Classifier with PyTorch Lightning, Transformers and PyTorch-NLP.
  ☆219Updated 2 years ago
• FreddeFrallan / Contrastive-Tension
  State of the art Semantic Sentence Embeddings
  ☆99Updated 3 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆136Updated 5 years ago
• lucidrains / g-mlp-gpt
  GPT, but made only out of MLPs
  ☆89Updated 4 years ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆164Updated last year
• shentianxiao / text-autoencoders
  ☆211Updated last year
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆49Updated 2 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆107Updated 4 years ago
• timoschick / dino
  This repository contains the code for "Generating Datasets with Pretrained Language Models".
  ☆188Updated 4 years ago