PERT: Pre-training BERT with Permuted Language Model
☆367Jul 15, 2025Updated 7 months ago
Alternatives and similar repositories for PERT
Users that are interested in PERT are comparing it to the libraries listed below
Sorting:
- LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）☆222Jul 15, 2025Updated 7 months ago
- ExpMRC: Explainability Evaluation for Machine Reading Comprehension☆62Aug 30, 2023Updated 2 years ago
- Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)☆700Jul 15, 2025Updated 7 months ago
- Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）☆10,175Jul 15, 2025Updated 7 months ago
- Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）☆1,440Jul 15, 2025Updated 7 months ago
- A PyTorch-based model pruning toolkit for pre-trained language models☆388Aug 31, 2023Updated 2 years ago
- Cross-Lingual Machine Reading Comprehension (EMNLP 2019)☆67Nov 6, 2019Updated 6 years ago
- 机器阅读理解 冠军/亚军代码及中文预训练MRC模型☆744Nov 19, 2022Updated 3 years ago
- ☆10Sep 27, 2021Updated 4 years ago
- Collections of resources from Joint Laboratory of HIT and iFLYTEK Research (HFL)☆376Mar 9, 2023Updated 2 years ago
- Pre-Trained Chinese XLNet（中文XLNet预训练模型）☆1,650Jul 15, 2025Updated 7 months ago
- A Sentence Cloze Dataset for Chinese Machine Reading Comprehension (CMRC 2019)☆126Oct 24, 2022Updated 3 years ago
- A 30000+ Chinese MRC dataset - Delta Reading Comprehension Dataset☆313Apr 21, 2020Updated 5 years ago
- CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation☆495Dec 30, 2022Updated 3 years ago
- RoBERTa中文预训练模型: RoBERTa for Chinese☆2,773Jul 22, 2024Updated last year
- MiniRBT (中文小型预训练模型系列)☆301Jul 15, 2025Updated 7 months ago
- code for ACL 2020 paper: FLAT: Chinese NER Using Flat-Lattice Transformer☆1,004May 10, 2022Updated 3 years ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,696May 8, 2023Updated 2 years ago
- 中文生成式预训练模型☆99Aug 28, 2020Updated 5 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,156Jan 22, 2024Updated 2 years ago
- A Span-Extraction Dataset for Chinese Machine Reading Comprehension (CMRC 2018)☆449Jun 15, 2022Updated 3 years ago
- MuCGEC中文纠错数据集及文本纠错SOTA模型开源；Code & Data for our NAACL 2022 Paper "MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Gr…☆565Jun 9, 2023Updated 2 years ago
- Pattern-Exploiting Training在中文上的简单实验☆173Oct 10, 2020Updated 5 years ago
- 全局指针统一处理嵌套与非嵌套NER的Pytorch实现☆412Mar 23, 2023Updated 2 years ago
- VLE: Vision-Language Encoder (VLE: 视觉-语言多模态预训练模型)☆194Mar 13, 2023Updated 2 years ago
- NEZHA: Neural Contextualized Representation for Chinese Language Understanding☆260Aug 13, 2021Updated 4 years ago
- CCL 2022 汉语学习者文本纠错评测☆142Dec 16, 2022Updated 3 years ago
- Code of the COLING22 paper "uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers"☆19Aug 17, 2022Updated 3 years ago
- Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"☆48May 25, 2022Updated 3 years ago
- The First Evaluation Workshop on Chinese Machine Reading Comprehension (CMRC 2017)☆92May 28, 2019Updated 6 years ago
- Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合☆5,519Feb 16, 2026Updated 2 weeks ago
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,641Oct 16, 2024Updated last year
- SimCSE在中文任务上的简单实验☆606Aug 7, 2023Updated 2 years ago
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆3,106May 9, 2024Updated last year
- GAU-alpha-pytorch☆20May 11, 2022Updated 3 years ago
- ☆272Jul 26, 2024Updated last year
- Code for ACL 2021 paper "ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information"☆567Jul 26, 2023Updated 2 years ago
- Code for the ACL2021 paper "Lexicon Enhanced Chinese Sequence Labelling Using BERT Adapter"☆345Jan 15, 2022Updated 4 years ago
- Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。☆4,147Aug 13, 2024Updated last year