cloudyskyy / Guwen-UNILMLinks
本仓库是基于bert4keras实现的古文-现代文翻译模型。具体使用了基于掩码自注意力机制的UNILM(Li al., 2019)预训练模型作为翻译系统的backbone。我们首先使用了普通的中文（现代文）BERT、Roberta权重作为UNILM的初始权重以训练UNILM模型（具体在文中分别为B-UNILM以及R-UNILM）。为了更好的使UNILM模型适应古文的特性，我们尝试使用了在古文预训练模型Guwen-BERT，作为UNILM的初始权重，并且获得了最优的效果。
☆53Updated 3 years ago
Alternatives and similar repositories for Guwen-UNILM
Users that are interested in Guwen-UNILM are comparing it to the libraries listed below
Sorting:
- SikuBERT：四库全书的预训练语言模型（四库BERT） Pre-training Model of Siku Quanshu☆151Updated 2 years ago
- GuwenModels: 古文自然语言处理模型合集, 收录互联网上的古文相关模型及资源. A collection of Classical Chinese natural language processing models, including Classical Ch…☆196Updated 2 years ago
- ☆39Updated 2 years ago
- A Benchmark for Classical Chinese Based on a Crowdsourcing System.☆59Updated 4 years ago
- a Corpus for Classical Chinese Language Event Extraction☆24Updated 2 months ago
- 基于GOOGLE T5中文生成式模型的摘要生成/指代消解，支持batch批量生成，多进程☆229Updated 2 years ago
- Source code for the paper "Improving Chinese Spelling Check by Character Pronunciation Prediction: The Effects of Adaptivity and Granular…☆43Updated 2 years ago
- Yet Another Chinese Learner Corpus☆78Updated 4 years ago
- text correction papers☆313Updated 2 years ago
- 古文语言理解测评基准 Classical Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆54Updated 2 years ago
- CCL 2020 中文隐喻识别与情感分析任务说明与数据集☆41Updated 5 years ago
- 非官方的MDCSpell论文的实现☆18Updated 3 years ago
- A PyTorch implementation of a BiLSTM \ BERT \ Roberta (+ BiLSTM + CRF) model for Chinese Word Segmentation (中文分词) .☆217Updated 3 years ago
- ☆420Updated last year
- SIGHAN中文纠错数据集及转换后格式☆71Updated 5 years ago
- 全局指针统一处理嵌套与非嵌套NER的Pytorch实现☆411Updated 2 years ago
- 历届中文句法错误诊断技术评测数据集☆44Updated 3 years ago
- 文言文翻译、古文翻译 语料数据集☆51Updated 5 years ago
- 本人项目进行中 搜集的数据集，包含原始数据和经过处理后的数据，项目持续更新。☆117Updated 5 years ago
- MuCGEC中文纠错数据集及文本纠错SOTA模型开源；Code & Data for our NAACL 2022 Paper "MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Gr…☆563Updated 2 years ago
- ☆30Updated 2 years ago
- ☆107Updated last year
- A Multi-modal Model Chinese Spell Checker Released on ACL2021.☆159Updated 2 years ago
- 《Spelling Error Correction with Soft-Masked BERT》论文复现☆36Updated 4 years ago
- This is some summary code and model☆40Updated 4 years ago
- 中文文本纠错相关的论文、比赛和工具。☆71Updated 4 months ago
- The official GitHub repository for AC-EVAL, an ancient Chinese evaluation suite for large language models (LLMs)☆16Updated last year
- ☆273Updated last year
- AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation(古文预训练模型)☆70Updated 4 years ago
- 超长文本分类（大于1000字）；文档级/篇章级文本分类；主要是解决长距离依赖问题☆131Updated 4 years ago