howl-anderson / MicroTokenizerLinks
一个轻量且功能全面的中文分词器,帮助学生了解分词器的工作原理。MicroTokenizer: A lightweight Chinese tokenizer designed for educational and research purposes. Provides a practical, hands-on approach to understanding NLP concepts, featuring multiple tokenization algorithms and customizable models. Ideal for students, researchers, and NLP enthusiasts..
☆159Updated last year
Alternatives and similar repositories for MicroTokenizer
Users that are interested in MicroTokenizer are comparing it to the libraries listed below
Sorting:
- 各大中文分词性能评测☆158Updated 7 years ago
- This is a corpus of Chinese abbreviation, including negative full forms.☆199Updated 4 years ago
- Self complemented Pinyin2Chinese demo use algorithms including Trie and HMM model , 基于隐马尔科夫模型与Trie树的拼音切分与拼音转中文的简单demo实现。☆86Updated 7 years ago
- Train Wikidata with word2vec for word embedding tasks☆123Updated 7 years ago
- AbstractKnowledgeGraph, a systematic knowledge graph that concentrate on abstract thing including abstract entity and action. 抽象知识图谱,目前规模…☆248Updated 6 years ago
- 中文生成式预训练模型☆99Updated 5 years ago
- EventKGNELL, event knowlege graph never end learning system, a event-centric knowledge base search system,实时事理逻辑知识库终身学习系统项目和事件为核心的知识库搜索系统…☆73Updated 5 years ago
- 中文相关词典和语料库。☆176Updated 11 years ago
- 新词发现算法(NewWordDetection)☆92Updated 4 years ago
- 汉字字符特征提取器 (featurizer),提取汉字的特征(发音特征、字形特征)用做深度学习的特征 | A Chinese character feature extractor, which extracts the features of Chinese charac…☆299Updated last month
- 依存关系分析,NLP,自然语言处理☆85Updated 4 years ago
- 中文近义词表 Chinese Synonyms☆263Updated 8 years ago
- Corpus creator for Chinese Wikipedia☆41Updated 4 years ago
- 汉字字符特征提取工具,可以提取出字符中的字音(声母、韵母、声调)、字形(偏旁、部首)、四角编码等特征,同时可作为tensor输入到模型☆138Updated 5 years ago
- 李傲龍的博客☆82Updated last year
- NLP for human. A fast and easy-to-use natural language processing (NLP) toolkit, satisfying your imagination about NLP.☆286Updated 3 years ago
- HyponymyExtraction and Graph based on KB Schema, Baike-kb and online text extract, 基于知识概念体系,百科知识库,以及在线搜索结构化方式的词语上下位抽取与可视化展示☆171Updated 7 years ago
- ChineseTextualInference project including chinese corpus build and inferecence model, 中文文本推断项目,包括88万文本蕴含中文文本蕴含数据集的翻译与构建,基于深度学习的文本蕴含判定模型构建…☆176Updated 7 years ago
- NLP NER datasets video/music/book bio☆90Updated 5 years ago
- ☆75Updated 2 years ago
- 简易的中文纠错和消歧☆289Updated 10 years ago
- chinese anti semantic word search interface based on dict crawled from online resources, ChineseAntiword,针对中文词语的反义词查询接口☆60Updated 7 years ago
- This directory contains the training, test, and gold-standard data used in the 2nd International Chinese Word Segmentation Bakeoff. Also …☆67Updated 7 years ago
- 基于百度webqa与dureader数据集训练的Albert Large QA模型☆77Updated 5 years ago
- NLU is hard!!!