Morizeyao / GPT2-ChineseLinks
Chinese version of GPT2 training code, using BERT tokenizer.
☆7,584Updated last year
Alternatives and similar repositories for GPT2-Chinese
Users that are interested in GPT2-Chinese are comparing it to the libraries listed below
Sorting:
- GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)☆3,013Updated last year
- GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型☆1,713Updated 2 years ago
- 大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP☆9,779Updated last year
- 中文公开聊天语料库☆4,147Updated last year
- 中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆4,181Updated last year
- Chinese Pre-Trained Language Models (CPM-LM) Version-I☆1,584Updated 2 years ago
- Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）☆10,062Updated last month
- A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models☆1,894Updated 2 years ago
- pycorrector is a toolkit for text error correction. 文本纠错，实现了Kenlm，T5，MacBERT，ChatGLM3，Qwen2.5等模型应用在纠错场景，开箱即用。☆6,150Updated last month
- 搜索所有中文NLP数据集，附常用英文NLP数据集☆4,367Updated 2 years ago
- 中文自然语言处理数据集，平时做做实验的材料。欢迎补充提交合并。☆4,480Updated last year
- 搜集、整理、发布 中文 自然语言处理 语料/数据集，与 有志之士 共同 促进 中文 自然语言处理 的 发展。☆6,312Updated 6 years ago
- 中文近义词：聊天机器人，智能问答工具包☆5,095Updated last month
- 中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com☆3,706Updated last month
- RoBERTa中文预训练模型: RoBERTa for Chinese☆2,737Updated last year
- transformer xl在中文文本生成上的尝试（可写小说、古诗）（transformer xl for text generation of chinese）☆724Updated 3 years ago
- text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。☆4,844Updated 2 months ago
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,984Updated 2 years ago
- keras implement of transformers for humans☆5,418Updated 9 months ago
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆3,078Updated last year
- Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。☆4,143Updated last year
- fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.☆3,137Updated 2 years ago
- A curated list of resources for Chinese NLP 中文自然语言处理相关资料☆7,911Updated 2 years ago
- 百度NLP：分词，词性标注，命名实体识别，词重要性☆3,966Updated 4 years ago
- pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation☆6,652Updated 2 years ago
- 100+ Chinese Word Vectors 上百种预训练中文词向量☆12,067Updated last year
- Easy-to-use CPM for Chinese text generation（基于CPM的中文文本生成）☆535Updated 2 years ago
- Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard☆1,781Updated 2 years ago
- MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志…☆3,965Updated last week
- Jiagu深度学习自然语言处理工具 知识图谱关系抽取 中文分词 词性标注 命名实体识别 情感分析 新词发现 关键词 文本摘要 文本聚类☆3,411Updated 3 years ago