本仓库是基于bert4keras实现的古文-现代文翻译模型。具体使用了基于掩码自注意力机制的UNILM(Li al., 2019)预训练模型作为翻译系统的backbone。我们首先使用了普通的中文(现代文)BERT、Roberta权重作为UNILM的初始权重以训练UNILM模型(具体在文中分别为B-UNILM以及R-UNILM)。为了更好的使UNILM模型适应古文的特性,我们尝试使用了在古文预训练模型Guwen-BERT,作为UNILM的初始权重,并且获得了最优的效果。
☆53May 3, 2022Updated 4 years ago
Alternatives and similar repositories for Guwen-UNILM
Users that are interested in Guwen-UNILM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Oct 6, 2023Updated 2 years ago
- 基于ChineseAlpaca微调的,专精与古汉语翻译、古汉语断句的大语言模型☆21Aug 20, 2023Updated 2 years ago
- The repository for the paper: Rethinking Document-level Neural Machine Translation☆25Dec 20, 2022Updated 3 years ago
- An educational Chinese-to-English NMT project featuring the classic encoder-decoder Transformer and a configurable modern decoder-only GP…☆20Updated this week
- GuwenBERT: 古文预训练语言模型(古文BERT) A Pre-trained Language Model for Classical Chinese (Literary Chinese)☆563Aug 31, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Pretrained BERT for Ancient (Classical) Chinese, with an expanded vocabulary for rare characters.☆45Feb 20, 2023Updated 3 years ago
- GuwenModels: 古文自然语言处理模型合集, 收录互联 网上的古文相关模型及资源. A collection of Classical Chinese natural language processing models, including Classical Ch…☆197Dec 11, 2023Updated 2 years ago
- AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation(古文预训练模型)☆75Jul 16, 2021Updated 4 years ago
- 渊 - A project for Classical Chinese☆110Feb 23, 2022Updated 4 years ago
- 古文语言理解测评基准 Classical Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆58Aug 23, 2023Updated 2 years ago
- 使用UniLM实现中文文本摘要☆43Mar 25, 2020Updated 6 years ago
- A Benchmark for Classical Chinese Based on a Crowdsourcing System.☆60May 25, 2021Updated 5 years ago
- 分别使用TextRank、BiLSTM和UniLM实现中文文章标题自动生成☆28Sep 22, 2020Updated 5 years ago
- CHisIEC An Information Extraction Corpus for Ancient Chinese History☆22Nov 25, 2025Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 本项目使用云问科技训练的中文版UniLM模型对微博数据集进行自动标题生成。☆39Apr 4, 2024Updated 2 years ago
- 本项目旨在构建一套多场景下可复用的辅助决策型智能 Agent 系统。通过提取用户输入的关键信息,结合历史数据进行智能匹配,系统可在教育路径、法律咨询、金融投资、心理健康、企业经营、供应链优化、危机应对、智能客服等多个领域提供个性化决策建议。系统采用统一的决策流程设计,具备高…☆27Mar 7, 2026Updated 3 months ago
- 甲言,专注于古代汉语(古汉语/古文/文言文/文言) 处理的NLP工具包,支持文言词库构建、分词、词性标注、断句和标点。Jiayan, the 1st NLP toolkit designed for Classical Chinese, supports lexicon co…☆673Nov 2, 2021Updated 4 years ago
- 使用transformer构建的机器翻译系统☆10Jun 16, 2023Updated 2 years ago
- Official code of our work, Syntax-augmented Multilingual BERT for Cross-lingual Transfer [ACL 2021].☆16Dec 2, 2021Updated 4 years ago
- Dataset and Source code of paper 'Enhancing Keyphrase Extraction from Academic Articles with their Reference Information'.☆18Dec 26, 2022Updated 3 years ago
- ☆21Apr 30, 2023Updated 3 years ago
- SikuBERT:四库全书的预训练语言模型(四库BERT) Pre-training Model of Siku Quanshu☆164Jul 30, 2023Updated 2 years ago
- 古文现代文翻译平行语料库☆116Jan 12, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The repository for the paper: Multilingual Translation via Grafting Pre-trained Language Models☆24Sep 22, 2021Updated 4 years ago
- 一个基于 LangGraph 和 LangSmith 构建的多智能体AI系统☆33Jun 5, 2025Updated last year
- 基于LangGraph构建的智能客服系统,结合RAG知识检索和Ollama本地推理,实现高效精准的客服对话体验。☆22Jun 9, 2025Updated last year
- 斗破苍穹小说的新词发现☆13May 12, 2022Updated 4 years ago
- A demonstration of Jupyter Book functionality using QuantEcon Python programming source material.☆14Oct 30, 2020Updated 5 years ago
- Neural Fuzzy Repair (NFR) is a data augmentation pipeline, which integrates fuzzy matches (i.e. similar translations) into neural machine…☆12Aug 14, 2024Updated last year
- 新闻人物言论自动提取---->得到说话的人和说话的内容☆10Jan 17, 2020Updated 6 years ago
- ☆11May 28, 2024Updated 2 years ago
- Python scripts and datasets of the "Extremely Low-Resource Neural Machine Translation: A Case Study of Cantonese" project☆16Oct 28, 2022Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆11May 29, 2024Updated 2 years ago
- Code for paper "ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models"☆17Mar 29, 2024Updated 2 years ago
- ☆13May 15, 2021Updated 5 years ago
- Art generation using VQGAN + CLIP using docker containers. A simplified, updated, and expanded upon version of Kevin Costa's work. This p…☆17Jul 4, 2022Updated 3 years ago
- Global Greedy Dependency Parsing☆10Mar 16, 2021Updated 5 years ago
- Tokenizer POS-tagger and Dependency-parser for Classical Chinese☆19Dec 16, 2021Updated 4 years ago
- 政策新闻领域 实体识别+关系抽取 基于4000句txt微调得到☆12Apr 9, 2024Updated 2 years ago