Alternatives and similar repositories for electra-pytorch

Users that are interested in electra-pytorch are comparing it to the libraries listed below

• richarddwang / electra_pytorch
  Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
  ☆330Updated last year
• lucidrains / mlm-pytorch
  An implementation of masked language modeling for Pytorch, made as concise and simple as possible
  ☆179Updated 2 years ago
• bloodwass / mixout
  Implementation of Mixout with PyTorch
  ☆75Updated 2 years ago
• archinetai / smart-pytorch
  PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.
  ☆62Updated 3 years ago
• yang-zhang / lightning-language-modeling
  Language Modeling Example with Transformers and PyTorch Lighting
  ☆65Updated 4 years ago
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆118Updated 4 years ago
• IntelLabs / academic-budget-bert
  Repository containing code for "How to Train BERT with an Academic Budget" paper
  ☆314Updated 2 years ago
• laiguokun / Funnel-Transformer
  ☆219Updated 5 years ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆330Updated 3 years ago
• ofirpress / shortformer
  Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
  ☆147Updated 4 years ago
• voidism / DiffCSE
  Code for the NAACL 2022 long paper "DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings"
  ☆296Updated 2 years ago
• helboukkouri / character-bert
  Main repository for "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"
  ☆201Updated 2 years ago
• lucidrains / marge-pytorch
  Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
  ☆76Updated 4 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆137Updated 2 years ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆113Updated 2 years ago
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆49Updated 2 years ago
• ricardorei / lightning-text-classification
  Minimalist implementation of a BERT Sentence Classifier with PyTorch Lightning, Transformers and PyTorch-NLP.
  ☆219Updated 2 years ago
• Lightning-Universe / lightning-transformers
  Flexible components pairing 🤗 Transformers with Pytorch Lightning
  ☆612Updated 2 years ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆156Updated last year
• timoschick / dino
  This repository contains the code for "Generating Datasets with Pretrained Language Models".
  ☆188Updated 4 years ago
• rrmenon10 / ADAPET
  [EMNLP 2021] Improving and Simplifying Pattern Exploiting Training
  ☆153Updated 3 years ago
• martiansideofthemoon / rankgen
  Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…
  ☆138Updated 2 years ago
• lucidrains / h-transformer-1d
  Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
  ☆166Updated last year
• yueyu1030 / COSINE
  [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self…
  ☆204Updated 3 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆108Updated 4 years ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆300Updated 2 years ago
• facebookresearch / transformer-sequential
  Trains Transformer model variants. Data isn't shuffled between batches.
  ☆143Updated 2 years ago
• JohnGiorgi / DeCLUTR
  The corresponding code from our paper "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations". Do not hesitate to o…
  ☆380Updated 2 years ago
• FreddeFrallan / Contrastive-Tension
  State of the art Semantic Sentence Embeddings
  ☆99Updated 3 years ago
• tnq177 / transformers_without_tears
  Transformers without Tears: Improving the Normalization of Self-Attention
  ☆133Updated last year