huawei-noah / Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
☆3,025Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for Pretrained-Language-Model
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆2,997Updated 6 months ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,596Updated last year
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,927Updated last year
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,336Updated 7 months ago
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,411Updated 3 weeks ago
- Source code and dataset for ACL 2019 paper "ERNIE: Enhanced Language Representation with Informative Entities"☆1,413Updated 9 months ago
- Implementation of BERT that could load official pre-trained models for feature extraction and prediction☆2,430Updated 2 years ago
- bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目☆1,849Updated 3 years ago
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,181Updated last year
- ALBERT: A Lite BERT for Self-supervised Learning of Language Representations☆3,245Updated last year
- Google AI 2018 BERT pytorch implementation☆6,213Updated last year
- Multi-Task Deep Neural Networks for Natural Language Understanding☆2,235Updated 8 months ago
- Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）☆1,402Updated last year
- Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard☆1,776Updated last year
- An Open-source Neural Hierarchical Multi-label Text Classification Toolkit☆1,848Updated last year
- Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimo…☆6,311Updated 2 months ago
- RoBERTa中文预训练模型: RoBERTa for Chinese☆2,614Updated 3 months ago
- Must-read Papers on pre-trained language models.☆3,321Updated 2 years ago
- fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.☆3,069Updated last year
- Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includ…☆2,392Updated 2 months ago
- Pre-Trained Chinese XLNet（中文XLNet预训练模型）☆1,653Updated last year
- 中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆4,004Updated 5 months ago
- novel deep learning research works with PaddlePaddle☆1,716Updated 2 months ago
- BERT-related papers☆2,033Updated last year
- EasyTransfer is designed to make the development of transfer learning in NLP applications easier.☆853Updated 2 years ago
- ☆3,611Updated 2 years ago
- Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://…☆2,389Updated 3 years ago
- PyTorch original implementation of Cross-lingual Language Model Pretraining.☆2,889Updated last year
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,118Updated last year
- keras implement of transformers for humans☆5,367Updated last year