pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation
☆6,699Nov 5, 2022Updated 3 years ago
Alternatives and similar repositories for pkuseg-python
Users that are interested in pkuseg-python are comparing it to the libraries listed below
Sorting:
- An Efficient Lexical Analyzer for Chinese☆2,089Jan 31, 2022Updated 4 years ago
- 100+ Chinese Word Vectors 上百种预训练中文词向量☆12,183Oct 30, 2023Updated 2 years ago
- 结巴中文分词☆34,767Aug 21, 2024Updated last year
- Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）☆10,175Jul 15, 2025Updated 7 months ago
- 大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP☆9,855Feb 6, 2026Updated 3 weeks ago
- 百度NLP：分词，词性标注，命名实体识别，词重要性☆3,986May 25, 2021Updated 4 years ago
- 中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理☆36,146Nov 15, 2025Updated 3 months ago
- 中文分词☆3,211Jan 16, 2025Updated last year
- Language Technology Platform☆5,236Jun 2, 2025Updated 8 months ago
- A curated list of resources for Chinese NLP 中文自然语言处理相关资料☆7,925Jul 27, 2023Updated 2 years ago
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,983Nov 21, 2022Updated 3 years ago
- 中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽…☆79,098May 10, 2024Updated last year
- 中文近义词：聊天机器人，智能问答工具包☆5,106Feb 1, 2026Updated last month
- Jiagu深度学习自然语言处理工具 知识图谱关系抽取 中文分词 词性标注 命名实体识别 情感分析 新词发现 关键词 文本摘要 文本聚类☆3,422May 7, 2022Updated 3 years ago
- Python library for processing Chinese text☆6,606Jan 19, 2020Updated 6 years ago
- fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.☆3,144Jun 5, 2023Updated 2 years ago
- pycorrector is a toolkit for text error correction. 文本纠错，实现了Kenlm，T5，MacBERT，ChatGLM3，Qwen2.5等模型应用在纠错场景，开箱即用。☆6,374Jan 12, 2026Updated last month
- 中文常用停用词表（哈工大停用词表、百度停用词表等）☆5,477Jan 25, 2024Updated 2 years ago
- Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services☆4,900Feb 24, 2021Updated 5 years ago
- The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.☆7,681Jan 4, 2026Updated last month
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆3,106May 9, 2024Updated last year
- 搜集、整理、发布 中文 自然语言处理 语料/数据集，与 有志之士 共同 促进 中文 自然语言处理 的 发展。☆6,477Jan 29, 2019Updated 7 years ago
- 中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard☆4,230Feb 6, 2026Updated 3 weeks ago
- RoBERTa中文预训练模型: RoBERTa for Chinese☆2,773Jul 22, 2024Updated last year
- 中文自然语言处理数据集，平时做做实验的材料。欢迎补充提交合并。☆4,575Nov 21, 2023Updated 2 years ago
- pyltp: the python extension for LTP☆1,549Jul 24, 2022Updated 3 years ago
- TensorFlow code and pre-trained models for BERT☆39,875Jul 23, 2024Updated last year
- 史上最大规模1.4亿中文知识图谱开源下载☆5,155Dec 6, 2023Updated 2 years ago
- Datasets, SOTA results of every fields of Chinese NLP☆1,812Apr 7, 2022Updated 3 years ago
- Chinese NER using Lattice LSTM. Code for ACL 2018 paper.☆1,834Apr 25, 2019Updated 6 years ago
- keras implement of transformers for humans☆5,421Nov 11, 2024Updated last year
- 中文医学NLP公开资源整理：术语集/语料库/词向量/预训练模型/知识图谱/命名实体识别/QA/信息抽取/模型/论文/etc☆2,541Jan 17, 2024Updated 2 years ago
- 🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP☆12,817Jan 23, 2024Updated 2 years ago
- 文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法☆2,598May 13, 2024Updated last year
- 中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com☆3,799Nov 27, 2025Updated 3 months ago
- 搜索所有中文NLP数据集，附常用英文NLP数据集☆4,419Nov 21, 2022Updated 3 years ago
- Pre-Trained Chinese XLNet（中文XLNet预训练模型）☆1,650Jul 15, 2025Updated 7 months ago
- Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includ…☆2,388Sep 3, 2024Updated last year
- Chinese version of GPT2 training code, using BERT tokenizer.☆7,600Apr 25, 2024Updated last year