Alternatives and similar repositories for BERT-pre-training

Users that are interested in BERT-pre-training are comparing it to the libraries listed below

• haoyuhu / bert-multi-gpu
  Feel free to fine tune large BERT models with Multi-GPU and FP16 support.
  ☆191Updated 5 years ago
• CLUEbenchmark / DistilBert
  DistilBERT for Chinese 海量中文预训练蒸馏bert模型
  ☆95Updated 5 years ago
• FeiSun / ProductTitleSummarizationCorpus
  Dataset for CIKM 2018 paper "Multi-Source Pointer Network for Product Title Summarization"
  ☆73Updated 7 years ago
• xiongma / roberta-wwm-base-distill
  this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large
  ☆66Updated 5 years ago
• ymcui / cmrc2019
  A Sentence Cloze Dataset for Chinese Machine Reading Comprehension (CMRC 2019)
  ☆127Updated 3 years ago
• rokid / ELMo-chinese
  Deep contextualized word representations for Chinese
  ☆151Updated 6 years ago
• HsiaoYetGun / ESIM
  TensorFlow implementation of the ESIM model (Enhanced LTSM for natural language inference)
  ☆77Updated 6 years ago
• wipen / bert_and_ernie
  TensorFlow code and pre-trained models for BERT and ERNIE
  ☆148Updated 6 years ago
• SunnyMarkLiu / lic2019-dureader2.0-rank2
  Rank2 solution (no-BERT) for 2019 Language and Intelligence Challenge - DuReader2.0 Machine Reading Comprehension.
  ☆128Updated 6 years ago
• ymcui / Chinese-RC-Datasets
  Collections of Chinese reading comprehension datasets
  ☆220Updated 5 years ago
• chin-gyou / dialogue-utterance-rewriter
  ☆220Updated 6 years ago
• brightmart / multi-label_classification
  transform multi-label classification as sentence pair task, with more training data and information
  ☆178Updated 5 years ago
• brightmart / xlnet_zh
  中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large
  ☆231Updated 6 years ago
• xu-song / bert-as-language-model
  BERT as language model, fork from https://github.com/google-research/bert
  ☆249Updated last year
• lambdal / bert
  TensorFlow code and pre-trained models for BERT
  ☆116Updated 5 years ago
• practicingman / bert_serving
  export bert model for serving
  ☆141Updated 6 years ago
• zhangxiangxiao / glyph
  Which Encoding is the Best for Text Classification in Chinese, English, Japanese and Korean?
  ☆173Updated 7 years ago
• lixinsu / RCZoo
  question answering, reading comprehension toolkit
  ☆166Updated 3 years ago
• saurabhkulkarni77 / DistillBERT
  ☆61Updated 6 years ago
• ewrfcas / bert_cn_finetune
  Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3
  ☆185Updated 5 years ago
• qiufengyuyi / bert-of-theseus-tf
  tensorflow version of bert-of-theseus
  ☆63Updated 4 years ago
• wangmuy / awesome-nlp-chinese-corpus
  A curated list of resources of chinese corpora for NLP(Natural Language Processing)
  ☆75Updated 6 years ago
• DataTerminatorX / Keyword-BERT
  ☆280Updated 4 years ago
• lonePatient / CLUE_pytorch
  CLUE baseline pytorch CLUE的pytorch版本基线
  ☆75Updated 5 years ago
• BitVoyage / FastBERT
  对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf
  ☆194Updated 3 years ago
• zhpmatrix / bert-sequence-tagging
  基于BERT的中文序列标注
  ☆141Updated 7 years ago
• CLUEbenchmark / ELECTRA
  中文 预训练 ELECTRA 模型: 基于对抗学习 pretrain Chinese Model
  ☆141Updated 5 years ago
• stevezheng23 / xlnet_extension_tf
  XLNet Extension in TensorFlow
  ☆131Updated 4 years ago
• brightmart / slot_filling_intent_joint_model
  attention based joint model for intent detection and slot filling
  ☆179Updated 7 years ago
• YunwenTechnology / QueryGeneration
  ☆90Updated 5 years ago