本仓库是基于bert4keras实现的古文-现代文翻译模型。具体使用了基于掩码自注意力机制的UNILM(Li al., 2019)预训练模型作为翻译系统的backbone。我们首先使用了普通的中文(现代文)BERT、Roberta权重作为UNILM的初始权重以训练UNILM模型(具体在文中分别为B-UNILM以及R-UNILM)。为了更好的使UNILM模型适应古文的特性,我们尝试使用了在古文预训练模型Guwen-BERT,作为UNILM的初始权重,并且获得了最优的效果。
☆54May 3, 2022Updated 4 years ago
Alternatives and similar repositories for Guwen-UNILM
Users that are interested in Guwen-UNILM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Oct 6, 2023Updated 2 years ago
- The repository for the paper: Rethinking Document-level Neural Machine Translation☆25Dec 20, 2022Updated 3 years ago
- 非常全的文言文(古文)-现代文平行语料☆1,473Apr 21, 2024Updated 2 years ago
- Pretrained BERT for Ancient (Classical) Chinese, with an expanded vocabulary for rare characters.☆48Feb 20, 2023Updated 3 years ago
- AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation(古文预训练模型)☆75Jul 16, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Workshop on Language Technologies for Historical and Ancient Languages (LT4HALA)☆38May 19, 2026Updated 2 months ago
- 渊 - A project for Classical Chinese☆111Feb 23, 2022Updated 4 years ago
- This is an interpreter which translate classical Chinese to modern Chinese. 该项目是一个把文言文翻译成现代文的翻译器☆36May 5, 2023Updated 3 years ago
- 古文语言理解测评基准 Classical Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆58Aug 23, 2023Updated 2 years ago
- 文言文信息抽取(实体识别+关系抽取)☆10Feb 24, 2023Updated 3 years ago
- 使用UniLM实现中文文本摘要☆43Mar 25, 2020Updated 6 years ago
- A Benchmark for Classical Chinese Based on a Crowdsourcing System.☆60May 25, 2021Updated 5 years ago
- 本项目使用云问科技训练的中文版UniLM模型对微博数据集进行自动标题生成。☆39Apr 4, 2024Updated 2 years ago
- 甲言,专注于古代汉语(古汉语/古文/文言文/文言)处理的NLP工具包,支持文言词库构建、分词、词性标注、断句和标点。Jiayan, the 1st NLP toolkit designed for Classical Chinese, supports lexicon co…☆678Nov 2, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An evaluation bentchmark for classical Chinese☆20Dec 13, 2023Updated 2 years ago
- Tokenizer POS-tagger and Dependency-parser for Classical Chinese☆21Jul 28, 2026Updated 2 weeks ago
- Dataset and Source code of paper 'Enhancing Keyphrase Extraction from Academic Articles with their Reference Information'.☆18Dec 26, 2022Updated 3 years ago
- SikuBERT:四库全书的预训练语言模型(四库BERT) Pre-training Model of Siku Quanshu☆168Jul 30, 2023Updated 3 years ago
- 古文现代文翻译平行语料库☆117Jan 12, 2022Updated 4 years ago
- The repository for the paper: Multilingual Translation via Grafting Pre-trained Language Models☆24Sep 22, 2021Updated 4 years ago
- The augmented data of the paper "Parallel Data Augmentation for Formality Style Transfer" (ACL 2020).☆12May 14, 2020Updated 6 years ago
- Neural Fuzzy Repair (NFR) is a data augmentation pipeline, which integrates fuzzy matches (i.e. similar translations) into neural machine…☆12Aug 14, 2024Updated last year
- ☆11May 28, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 新闻人物言论自动提取---->得到说话的人和说话的内容☆10Jan 17, 2020Updated 6 years ago
- Source code for the AAAI 2020 long paper <Modeling Fluency and Faithfulness for Diverse Neural Machine Translation>.☆19Mar 10, 2020Updated 6 years ago
- ☆11May 29, 2024Updated 2 years ago
- Code for paper "ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models"☆17Mar 29, 2024Updated 2 years ago
- ☆13May 15, 2021Updated 5 years ago
- BERT微调在机器翻译上的应用,哎哟,效果贼好。☆50Mar 1, 2021Updated 5 years ago
- Global Greedy Dependency Parsing☆10Mar 16, 2021Updated 5 years ago
- 金庸和古龙之间的文本风格转换☆26Aug 2, 2022Updated 4 years ago
- 古诗词分词,词向量分析,输出到excel,云图☆10Jul 6, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 贵州大学“水纹智识·灵境孪生”项目,由杨秀璋团队指导,在冯静、罗恩瑞、 郭春山、李灿灿等努力下共同推进。该资源将应用人工智能技术研究水族文化、文字和古籍,已有多所高校参与。为更好的抢救和保护濒危水族文字和非物质文化遗产,作者申请并开源了该项目,主要通过人工智能技术识别水书,构…☆52Jun 30, 2025Updated last year
- A trained model to predict sentiment class of a given Persian text.☆10Jan 26, 2021Updated 5 years ago
- 基于同义词词林实现上下位关系自动抽取☆14May 15, 2020Updated 6 years ago
- codes for "Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models"☆12Feb 10, 2025Updated last year
- Hanja Understanding Evaluation Dataset☆15May 2, 2022Updated 4 years ago
- Chinese Named Entity Recognition with IDCNN/biLSTM+CRF, and Relation Extraction with biGRU+2ATT 中文实体识别与关系提取☆15Nov 16, 2019Updated 6 years ago
- A JavaScript viewer for geospatial linked data☆15Apr 26, 2022Updated 4 years ago