google-research / electra
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
☆2,351Updated last year
Alternatives and similar repositories for electra:
Users that are interested in electra are comparing it to the libraries listed below
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,905Updated 2 years ago
- ALBERT: A Lite BERT for Self-supervised Learning of Language Representations☆3,268Updated 2 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,187Updated last year
- Source code and dataset for ACL 2019 paper "ERNIE: Enhanced Language Representation with Informative Entities"☆1,415Updated last year
- A python tool for evaluating the quality of sentence embeddings.☆2,104Updated last year
- BERT-related papers☆2,045Updated last year
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,118Updated 2 years ago
- Must-read Papers on pre-trained language models.☆3,360Updated 2 years ago
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,251Updated last year
- Super easy library for BERT based NLP models☆1,891Updated 7 months ago
- Longformer: The Long-Document Transformer☆2,104Updated 2 years ago
- Tensorflow implementation of contextualized word representations from bi-directional language models☆1,619Updated 2 years ago
- A curated list of pretrained sentence and word embedding models☆2,258Updated 3 years ago
- Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.☆1,143Updated last year
- Code for paper Fine-tune BERT for Extractive Summarization☆1,485Updated 3 years ago
- [DEPRECATED] Repo for exploring multi-task learning approaches to learning sentence representations☆791Updated 3 years ago
- Unsupervised Word Segmentation for Neural Machine Translation and Text Generation☆2,229Updated 8 months ago
- NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character …☆1,895Updated 2 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,080Updated last year
- Code for using and evaluating SpanBERT.☆896Updated last year
- Simple XLNet implementation with Pytorch Wrapper☆582Updated 5 years ago
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,535Updated 6 months ago
- Data augmentation for NLP, presented at EMNLP 2019☆1,630Updated 2 years ago
- jiant is an nlp toolkit☆1,665Updated last year
- Pre-trained ELMo Representations for Many Languages☆1,461Updated 3 years ago
- A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.☆808Updated 2 years ago
- Language-Agnostic SEntence Representations☆3,632Updated 11 months ago
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"☆6,325Updated last month
- ☆3,641Updated 2 years ago
- Implementation of BERT that could load official pre-trained models for feature extraction and prediction☆2,421Updated 3 years ago