cloudyskyy / Guwen-UNILM
本仓库是基于bert4keras实现的古文-现代文翻译模型。具体使用了基于掩码自注意力机制的UNILM(Li al., 2019)预训练模型作为翻译系统的backbone。我们首先使用了普通的中文(现代文)BERT、Roberta权重作为UNILM的初始权重以训练UNILM模型(具体在文中分别为B-UNILM以及R-UNILM)。为了更好的使UNILM模型适应古文的特性,我们尝试使用了在古文预训练模型Guwen-BERT,作为UNILM的初始权重,并且获得了最优的效果。
☆49Updated 2 years ago
Alternatives and similar repositories for Guwen-UNILM:
Users that are interested in Guwen-UNILM are comparing it to the libraries listed below
- A Benchmark for Classical Chinese Based on a Crowdsourcing System.☆57Updated 3 years ago
- ☆35Updated 2 years ago
- 古文语言理解测评基准 Classical Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆48Updated last year
- GuwenModels: 古文自然语言处理模型合集, 收录互联网上的古文相关模型及资源. A collection of Classical Chinese natural language processing models, including Classical Ch…☆175Updated last year
- SikuBERT:四库全书的预训练语言模型(四库BERT) Pre-training Model of Siku Quanshu☆130Updated last year
- 一个面向繁体中文古籍分词的python工具包☆32Updated 3 years ago
- 文言文命名实体识别,基于BILSTM+CRF完成文言文的命名实体实体,识别实体包括人物、地点、机构、时间等。☆9Updated 4 years ago
- 古文现代文翻译平行语料库☆102Updated 3 years ago
- 非官方的MDCSpell论文的实现☆18Updated 2 years ago
- ☆27Updated last year
- 基于SpanBert的中文指代消解,pytorch实现☆97Updated 2 years ago
- a Corpus for Classical Chinese Language Event Extraction☆21Updated last year
- 历届中文句法错误诊断技术评测数据集☆40Updated 2 years ago
- 基于pytorch的中文拼写纠错,使用的模型是Bert以及SoftMaskedBert☆32Updated 3 years ago
- CCL 2022 汉语学习者文本纠错评测☆138Updated 2 years ago
- Yet Another Chinese Learner Corpus☆77Updated 3 years ago
- 大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP☆24Updated 6 years ago
- ☆35Updated 3 years ago
- ☆106Updated last year
- 基于prompt的中文文本分类。☆55Updated last year
- Ancient Chinese Corpus with Word Sense Annotation☆47Updated 10 months ago
- ☆267Updated 8 months ago
- 基于LLaMA2-7B增量预训练的藏文大语言模型TiLamb(Tibetan Large Language Model Base)☆23Updated last year
- SIGHAN中文纠错数据集及转换后格式☆64Updated 5 years ago
- The official GitHub repository for AC-EVAL, an ancient Chinese evaluation suite for large language models (LLMs)☆13Updated 5 months ago
- 论文复现《Named Entity Recognition as Dependency Parsing》☆130Updated 3 years ago
- 百度2021年语言与智能技术竞赛机器阅读理解torch版baseline☆53Updated 3 years ago
- AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation(古文预训练模型)☆66Updated 3 years ago
- Source code and dataset for ACL2022 Findings Paper "LEVEN: A Large-Scale Chinese Legal Event Detection dataset"☆110Updated last year
- 基于词汇信息融合的中文NER模型☆166Updated 3 years ago