DistilBERT for Chinese 海量中文预训练蒸馏bert模型
☆95Dec 5, 2019Updated 6 years ago
Alternatives and similar repositories for DistilBert
Users that are interested in DistilBert are comparing it to the libraries listed below
Sorting:
- LGEB: Benchmark of Language Generation Evaluation☆16Oct 21, 2022Updated 3 years ago
- ☆61Nov 14, 2019Updated 6 years ago
- this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large☆66Mar 30, 2020Updated 5 years ago
- 中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large☆229Sep 13, 2019Updated 6 years ago
- CLUE baseline pytorch CLUE的pytorch版本基线☆75Apr 3, 2020Updated 5 years ago
- Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）☆1,440Jul 15, 2025Updated 7 months ago
- 中文 预训练 ELECTRA 模型: 基于对抗学习 pretrain Chinese Model☆141Mar 22, 2020Updated 5 years ago
- RoBERTa中文预训练模型: RoBERTa for Chinese☆2,773Jul 22, 2024Updated last year
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,983Nov 21, 2022Updated 3 years ago
- 离线端阅读理解应用 QA for mobile, Android & iPhone☆60Oct 6, 2022Updated 3 years ago
- An attempt to make Google BERT closer to production before Hugging Face Transformers etc.☆28Sep 10, 2020Updated 5 years ago
- BERT distillation（基于BERT的蒸馏实验 ）☆314Jul 30, 2020Updated 5 years ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,696May 8, 2023Updated 2 years ago
- Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark☆133May 22, 2023Updated 2 years ago
- The code for CCF-BDCI-Sentiment-Analysis-Baseline☆430Dec 8, 2022Updated 3 years ago
- A BERT-based Chinese Text Encoder Enhanced by N-gram Representations☆647Jul 24, 2022Updated 3 years ago
- A Sentence Cloze Dataset for Chinese Machine Reading Comprehension (CMRC 2019)☆126Oct 24, 2022Updated 3 years ago
- Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard☆1,785Feb 18, 2023Updated 3 years ago
- all kinds of baseline models for sentence similarity 句子对语义相似度模型☆296Jul 5, 2018Updated 7 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,156Jan 22, 2024Updated 2 years ago
- Bert finetune for CMRC2018, CJRC, DRCD, CHID, C3☆184Jun 4, 2020Updated 5 years ago
- 高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型☆816Jul 8, 2020Updated 5 years ago
- The score code of FastBERT (ACL2020)☆609Oct 29, 2021Updated 4 years ago
- A Lite Bert For Self-Supervised Learning Language Representations☆715May 13, 2020Updated 5 years ago
- Text-Similarity Method in Pytorch☆469Dec 9, 2018Updated 7 years ago
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆3,106May 9, 2024Updated last year
- Source code of the ACL2019 paper "Simple and Effective Text Matching with Richer Alignment Features".☆340Oct 11, 2019Updated 6 years ago
- CLUEWSC2020: WSC Winograd模式挑战中文版，中文指代消解任务☆79May 24, 2020Updated 5 years ago
- machine reading comprehension with deep learning☆19Feb 6, 2018Updated 8 years ago
- Pre-Trained Chinese XLNet（中文XLNet预训练模型）☆1,650Jul 15, 2025Updated 7 months ago
- transform multi-label classification as sentence pair task, with more training data and information☆178Dec 13, 2019Updated 6 years ago
- 非常好用的工具包，可以直接安装并使用☆21Mar 18, 2022Updated 3 years ago
- Documentation for Chatstack: A Full Pipeline UI for building Chinese NLU System☆18Sep 7, 2019Updated 6 years ago
- Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）☆10,175Jul 15, 2025Updated 7 months ago
- Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN☆967Jan 1, 2019Updated 7 years ago
- Baseline Systems of DuReader Dataset☆1,166May 26, 2022Updated 3 years ago
- ☆279Dec 8, 2020Updated 5 years ago
- 文本匹配的相关模型DSSM,ESIM,ABCNN,BIMPM等，数据集为LCQMC官方数据☆470May 8, 2022Updated 3 years ago
- TensorFlow implementation of On the Sentence Embeddings from Pre-trained Language Models (EMNLP 2020)☆535May 19, 2021Updated 4 years ago