本仓库是基于bert4keras实现的古文-现代文翻译模型。具体使用了基于掩码自注意力机制的UNILM(Li al., 2019)预训练模型作为翻译系统的backbone。我们首先使用了普通的中文(现代文)BERT、Roberta权重作为UNILM的初始权重以训练UNILM模型(具体在文中分别为B-UNILM以及R-UNILM)。为了更好的使UNILM模型适应古文的特性,我们尝试使用了在古文预训练模型Guwen-BERT,作为UNILM的初始权重,并且获得了最优的效果。
☆53May 3, 2022Updated 3 years ago
Alternatives and similar repositories for Guwen-UNILM
Users that are interested in Guwen-UNILM are comparing it to the libraries listed below
Sorting:
- GuwenBERT: 古文预训练语言模型(古文BERT) A Pre-trained Language Model for Classical Chinese (Literary Chinese)☆555Aug 31, 2021Updated 4 years ago
- 文言文信息抽取(实体识别+关系抽取)☆10Feb 24, 2023Updated 3 years ago
- 非常全的文言文(古文)-现代文平行语料☆1,420Apr 21, 2024Updated last year
- CHisIEC An Information Extraction Corpus for Ancient Chinese History☆18Nov 25, 2025Updated 3 months ago
- GuwenModels: 古文自然语言处理模型合集, 收录互联网上的古文相关模型及资源. A collection of Classical Chinese natural language processing models, including Classical Ch…☆194Dec 11, 2023Updated 2 years ago
- A Benchmark for Classical Chinese Based on a Crowdsourcing System.☆59May 25, 2021Updated 4 years ago
- Workshop on Language Technologies for Historical and Ancient Languages (LT4HALA)☆35Mar 2, 2026Updated last week
- ☆41Feb 20, 2023Updated 3 years ago
- 渊 - A project for Classical Chinese☆110Feb 23, 2022Updated 4 years ago
- AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation(古文预训练模型)☆71Jul 16, 2021Updated 4 years ago
- CCL 2023 古汉语通假字语料库的构建及应用研究:通假字资源库☆21Sep 23, 2023Updated 2 years ago
- Dataset and Source code of paper 'Enhancing Keyphrase Extraction from Academic Articles with their Reference Information'.☆18Dec 26, 2022Updated 3 years ago
- Official code of our work, Syntax-augmented Multilingual BERT for Cross-lingual Transfer [ACL 2021].☆16Dec 2, 2021Updated 4 years ago
- 分别使用TextRank、BiLSTM和UniLM实现中文文章标题自动生成☆28Sep 22, 2020Updated 5 years ago
- This is an interpreter which translate classical Chinese to modern Chinese. 该项目是一个把文言文翻译成现代文的翻译器☆34May 5, 2023Updated 2 years ago
- 甲言,专注于古代汉语(古汉语/古文/文言文/文言)处理的NLP工具包,支持文言词库构建、分词、词性标注、断句和标点。Jiayan, the 1st NLP toolkit designed for Classical Chinese, supports lexicon co…☆655Nov 2, 2021Updated 4 years ago
- SikuBERT:四库全书的预训练语言模型(四库BERT) Pre-training Model of Siku Quanshu☆153Jul 30, 2023Updated 2 years ago
- Official repository for ACM Multimedia'23 paper "MATK: The Meme Analytical Tool Kit"☆13May 29, 2024Updated last year
- 本项目使用云问科技训练的中文版UniLM模型对微博数据集进行自动标题生成。☆39Apr 4, 2024Updated last year
- A trained model to predict sentiment class of a given Persian text.☆10Jan 26, 2021Updated 5 years ago
- 斗破苍穹小说的新词发现☆13May 12, 2022Updated 3 years ago
- Course repository for the Spring 2023 COMP664 course "Deep Learning" at UNC☆14Apr 17, 2023Updated 2 years ago
- Sequence Tagging for Biomedical Extractive Question Answering (Bioinformatics'2020)☆11Jul 3, 2023Updated 2 years ago
- CAIL2019-SCM: Similar case matching in legal domain☆10May 10, 2025Updated 9 months ago
- DatasetResearch: Benchmarking Agent Systems for Demand-Driven Dataset Discovery☆20Sep 24, 2025Updated 5 months ago
- codes for "Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models"☆12Feb 10, 2025Updated last year
- Improving Pseudo Labels with Global-Local Denoising Framework for Cross-lingual Named Entity Recognition (IJCAI 2024)☆11Aug 18, 2024Updated last year
- Analyze the content of one or more XML files. NormaTEI is designed mainly for two uses: control of encoding uniformity and encoding analy…☆18Nov 11, 2024Updated last year
- The official codes for our paper at COLING 2022: Semantic-Preserving Adversarial Code Comprehension☆12Oct 23, 2022Updated 3 years ago
- ☆10Sep 27, 2021Updated 4 years ago
- ☆11Nov 21, 2022Updated 3 years ago
- ☆10Oct 17, 2021Updated 4 years ago
- ☆10Jul 5, 2023Updated 2 years ago
- 贵州大学“水纹智识·灵境孪生”项目,由杨秀璋团队指导,在冯静、罗恩瑞、郭春山、李灿灿等努力下共同推进。该资源将应用人工智能技术研究水族文化、文字和古籍,已有多所高校参与。为更好的抢救和保护濒危水族文字和非物质文化遗产,作者申请并开源了该项目,主要通过人工智能技术识别水书,构…☆51Jun 30, 2025Updated 8 months ago
- 政策新闻领域 实体识别+关系抽取 基于4000句txt微调得到☆11Apr 9, 2024Updated last year
- ☆11May 29, 2024Updated last year
- Open-source repository for the OOPSLA'24 paper "CYCLE: Learning to Self-Refine Code Generation"☆10Mar 8, 2024Updated 2 years ago
- ☆13Oct 9, 2024Updated last year
- recursive rag with r1 reasoning☆11Feb 26, 2025Updated last year