本仓库是基于bert4keras实现的古文-现代文翻译模型。具体使用了基于掩码自注意力机制的UNILM(Li al., 2019)预训练模型作为翻译系统的backbone。我们首先使用了普通的中文(现代文)BERT、Roberta权重作为UNILM的初始权重以训练UNILM模型(具体在文中分别为B-UNILM以及R-UNILM)。为了更好的使UNILM模型适应古文的特性,我们尝试使用了在古文预训练模型Guwen-BERT,作为UNILM的初始权重,并且获得了最优的效果。
☆53May 3, 2022Updated 3 years ago
Alternatives and similar repositories for Guwen-UNILM
Users that are interested in Guwen-UNILM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Oct 6, 2023Updated 2 years ago
- 基于ChineseAlpaca微调的,专精与古汉语翻译、古汉语断句的大语言模型☆21Aug 20, 2023Updated 2 years ago
- 使用transformer模型实现机器翻译任务,针对中译英的翻译任务☆19Mar 26, 2024Updated 2 years ago
- microsoft unilm-v1 compatible with huggingface transformers☆22Apr 5, 2023Updated 2 years ago
- 非常全的文言文(古文)-现代文平行语料☆1,427Apr 21, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆41Feb 20, 2023Updated 3 years ago
- AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation(古文预训练模型)☆71Jul 16, 2021Updated 4 years ago
- GuwenModels: 古文自然语言处理模型合集, 收录互联网上的古文相关模型及资源. A collection of Classical Chinese natural language processing models, including Classical Ch…☆196Dec 11, 2023Updated 2 years ago
- 渊 - A project for Classical Chinese☆110Feb 23, 2022Updated 4 years ago
- This is an interpreter which translate classical Chinese to modern Chinese. 该项目是一个把文言文翻译成现代文的翻译器☆35May 5, 2023Updated 2 years ago
- 古文语言理解测评基准 Classical Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆58Aug 23, 2023Updated 2 years ago
- 文言文信息抽取(实体识别+关系抽取)☆10Feb 24, 2023Updated 3 years ago
- 使用UniLM实现中文文本摘要☆43Mar 25, 2020Updated 6 years ago
- A Benchmark for Classical Chinese Based on a Crowdsourcing System.☆60May 25, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- 分别使用TextRank、BiLSTM和UniLM实现中文文章标题自动生成☆28Sep 22, 2020Updated 5 years ago
- CHisIEC An Information Extraction Corpus for Ancient Chinese History☆20Nov 25, 2025Updated 4 months ago
- 本项目使用云问科技训练的中文版UniLM模型对微博数据集进行自动标题生成。☆39Apr 4, 2024Updated last year
- Toward Practical Entity Alignment Method Design: Insights from New Highly Heterogeneous Knowledge Graph Datasets☆17Feb 18, 2025Updated last year
- CCL 2023 古汉语通假字语料库的构建及应用研究:通假字资源库☆23Sep 23, 2023Updated 2 years ago
- An evaluation bentchmark for classical Chinese☆19Dec 13, 2023Updated 2 years ago
- 使用transformer构建的机器翻译系统☆10Jun 16, 2023Updated 2 years ago
- Tokenizer POS-tagger and Dependency-parser for Classical Chinese☆19Feb 28, 2026Updated last month
- Official code of our work, Syntax-augmented Multilingual BERT for Cross-lingual Transfer [ACL 2021].☆16Dec 2, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆13Oct 9, 2024Updated last year
- ☆21Apr 30, 2023Updated 2 years ago
- SikuBERT:四库全书的预训练语言模型(四库BERT) Pre-training Model of Siku Quanshu☆154Jul 30, 2023Updated 2 years ago
- [ICLR 2026] Official implementation of PBFM - Physics-Based Flow Matching☆43Feb 9, 2026Updated last month
- The augmented data of the paper "Parallel Data Augmentation for Formality Style Transfer" (ACL 2020).☆12May 14, 2020Updated 5 years ago
- 斗破苍穹小说的新词发现☆13May 12, 2022Updated 3 years ago
- 中文版unilm预训练模型☆82Feb 22, 2021Updated 5 years ago
- A demonstration of Jupyter Book functionality using QuantEcon Python programming source material.☆14Oct 30, 2020Updated 5 years ago
- 新闻人物言论自动提取---->得到说话的人和说话的内容☆11Jan 17, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- ☆11May 28, 2024Updated last year
- Python scripts and datasets of the "Extremely Low-Resource Neural Machine Translation: A Case Study of Cantonese" project☆16Oct 28, 2022Updated 3 years ago
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- Source code for the AAAI 2020 long paper <Modeling Fluency and Faithfulness for Diverse Neural Machine Translation>.☆19Mar 10, 2020Updated 6 years ago
- 抽取式NLP模型(阅读理解模型,MRC)实现词义消歧(WSD)☆14May 10, 2022Updated 3 years ago
- Code for paper "ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models"☆17Mar 29, 2024Updated 2 years ago
- ☆13May 15, 2021Updated 4 years ago