guotong1988 / BERT-pre-trainingView external linksLinks
multi-gpu pre-training in one machine for BERT without horovod (Data Parallelism)
☆171Dec 27, 2025Updated last month
Alternatives and similar repositories for BERT-pre-training
Users that are interested in BERT-pre-training are comparing it to the libraries listed below
Sorting:
- Feel free to fine tune large BERT models with Multi-GPU and FP16 support.☆192Mar 9, 2020Updated 5 years ago
- bert multiple gpu train pretrain☆29Apr 12, 2020Updated 5 years ago
- BERT for Multitask Learning☆544Apr 12, 2023Updated 2 years ago
- TensorFlow code and pre-trained models for BERT☆11May 2, 2019Updated 6 years ago
- TensorFlow code and pre-trained models for BERT☆24Apr 19, 2019Updated 6 years ago
- TensorFlow code and pre-trained models for BERT☆116Mar 11, 2020Updated 5 years ago
- bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目☆1,848Mar 21, 2021Updated 4 years ago
- Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL☆547Nov 18, 2020Updated 5 years ago
- RoBERTa中文预训练模型: RoBERTa for Chinese☆2,773Jul 22, 2024Updated last year
- 中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large☆229Sep 13, 2019Updated 6 years ago
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,986Nov 21, 2022Updated 3 years ago
- Pre-Trained Chinese XLNet（中文XLNet预训练模型）☆1,649Jul 15, 2025Updated 7 months ago
- export bert model for serving☆141Dec 12, 2018Updated 7 years ago
- Chinese Open Entity-Relation Knowledge Base☆36May 22, 2018Updated 7 years ago
- Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）☆1,439Jul 15, 2025Updated 7 months ago
- ALBERT: A Lite BERT for Self-supervised Learning of Language Representations☆3,274Apr 14, 2023Updated 2 years ago
- 预训练语言模型综述☆548Mar 25, 2020Updated 5 years ago
- 24*2个预训练的小型BERT模型，NLPer炼丹利器☆51Apr 12, 2020Updated 5 years ago
- BERT distillation（基于BERT的蒸馏实验 ）☆314Jul 30, 2020Updated 5 years ago
- Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services☆4,899Feb 24, 2021Updated 4 years ago
- Source code and dataset for ACL 2019 paper "ERNIE: Enhanced Language Representation with Informative Entities"☆1,419Jan 10, 2024Updated 2 years ago
- 中文预训练模型生成字向量学习，测试BERT，ELMO的中文效果☆100Jan 22, 2020Updated 6 years ago
- Implementation of BERT that could load official pre-trained models for feature extraction and prediction☆2,428Jan 22, 2022Updated 4 years ago
- ☆25May 4, 2022Updated 3 years ago
- Hierarchically-Refined Label Attention Network for Sequence Labeling☆293Apr 9, 2021Updated 4 years ago
- Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN☆968Jan 1, 2019Updated 7 years ago
- ☆61Nov 14, 2019Updated 6 years ago
- 文本匹配的相关模型DSSM,ESIM,ABCNN,BIMPM等，数据集为LCQMC官方数据☆470May 8, 2022Updated 3 years ago
- Tools for training pytorch language models☆27Nov 14, 2020Updated 5 years ago
- semantic role labeling based on deep learning, implemented by tensorflow☆16Aug 20, 2018Updated 7 years ago
- 利用预训练的中文模型实现基于bert的语义匹配模型 数据集为LCQMC官方数据☆198Dec 19, 2019Updated 6 years ago
- MASS: Masked Sequence to Sequence Pre-training for Language Generation☆1,123Nov 28, 2022Updated 3 years ago
- datagrand 2019 information extraction competition rank9☆130Dec 29, 2019Updated 6 years ago
- CCL2018客服领域用户意图分类冠军1st方案☆149Sep 5, 2022Updated 3 years ago
- 小布助手对话短文本语义匹配的一个baseline☆138Mar 8, 2021Updated 4 years ago
- ccks baidu entity link 实体链接 第一名☆843Dec 19, 2023Updated 2 years ago
- 速度更快、效果更好的中文新词发现☆513Mar 15, 2024Updated last year
- XLNet: Generalized Autoregressive Pretraining for Language Understanding☆6,177May 28, 2023Updated 2 years ago
- 高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型☆816Jul 8, 2020Updated 5 years ago