Alternatives and similar repositories for BERT-pre-training:

Users that are interested in BERT-pre-training are comparing it to the libraries listed below

• haoyuhu / bert-multi-gpu
  Feel free to fine tune large BERT models with Multi-GPU and FP16 support.
  ☆192Updated 5 years ago
• practicingman / bert_serving
  export bert model for serving
  ☆141Updated 6 years ago
• DataTerminatorX / Keyword-BERT
  ☆278Updated 4 years ago
• CLUEbenchmark / DistilBert
  DistilBERT for Chinese 海量中文预训练蒸馏bert模型
  ☆91Updated 5 years ago
• alibaba-edu / simple-effective-text-matching
  Source code of the ACL2019 paper "Simple and Effective Text Matching with Richer Alignment Features".
  ☆337Updated 5 years ago
• chin-gyou / dialogue-utterance-rewriter
  ☆217Updated 5 years ago
• wipen / bert_and_ernie
  TensorFlow code and pre-trained models for BERT and ERNIE
  ☆143Updated 5 years ago
• zhpmatrix / bert-sequence-tagging
  基于BERT的中文序列标注
  ☆141Updated 6 years ago
• ymcui / cmrc2019
  A Sentence Cloze Dataset for Chinese Machine Reading Comprehension (CMRC 2019)
  ☆126Updated 2 years ago
• BitVoyage / FastBERT
  对ACL2020 FastBERT论文的复现，论文地址//arxiv.org/pdf/2004.02178.pdf
  ☆193Updated 3 years ago
• ymcui / Chinese-RC-Datasets
  Collections of Chinese reading comprehension datasets
  ☆215Updated 5 years ago
• brightmart / xlnet_zh
  中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large
  ☆229Updated 5 years ago
• lambdal / bert
  TensorFlow code and pre-trained models for BERT
  ☆114Updated 5 years ago
• SunnyMarkLiu / lic2019-dureader2.0-rank2
  Rank2 solution (no-BERT) for 2019 Language and Intelligence Challenge - DuReader2.0 Machine Reading Comprehension.
  ☆127Updated 5 years ago
• xu-song / bert-as-language-model
  BERT as language model, fork from https://github.com/google-research/bert
  ☆248Updated last year
• HsiaoYetGun / ESIM
  TensorFlow implementation of the ESIM model (Enhanced LTSM for natural language inference)
  ☆76Updated 6 years ago
• searobbersduck / ELMo_Chin
  use ELMo in chinese environment
  ☆104Updated 6 years ago
• lixinsu / RCZoo
  question answering, reading comprehension toolkit
  ☆166Updated 2 years ago
• baidu / knowledge-driven-dialogue
  baseline system of knowledge driven dialogue competition
  ☆269Updated 5 years ago
• ewrfcas / bert_cn_finetune
  Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3
  ☆182Updated 4 years ago
• xiongma / roberta-wwm-base-distill
  this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large
  ☆65Updated 4 years ago
• EternalFeather / Transformer-in-generating-dialogue
  An Implementation of 'Attention is all you need' with Chinese Corpus
  ☆130Updated 9 months ago
• baidu / Dialogue
  ☆442Updated 2 years ago
• lonePatient / CLUE_pytorch
  CLUE baseline pytorch CLUE的pytorch版本基线
  ☆74Updated 4 years ago
• ArthurRizar / tensorflow_ernie
  将百度ernie的paddlepaddle模型转成tensorflow模型
  ☆177Updated 5 years ago
• MiuLab / SlotGated-SLU
  Slot-Gated Modeling for Joint Slot Filling and Intent Prediction
  ☆305Updated 3 years ago
• rokid / ELMo-chinese
  Deep contextualized word representations for Chinese
  ☆151Updated 5 years ago
• YunwenTechnology / QueryGeneration
  ☆89Updated 4 years ago
• galsang / BIMPM-pytorch
  Re-implementation of BIMPM (Bilateral Multi-Perspective Matching for Natural Language Sentences, Zhiguo Wang et al.) on Pytorch.
  ☆105Updated 5 years ago
• ankit-ai / BertQA-Attention-on-Steroids
  BertQA - Attention on Steroids
  ☆115Updated 2 years ago