Alternatives and similar repositories for pinyin-tokenizer

Users that are interested in pinyin-tokenizer are comparing it to the libraries listed below

• shibing624 / weibo-roast
  一个微博毒舌AI，疯狂 diss 微博博主
  ☆12Updated 5 months ago
• alanshi / charset_mnbvc
  本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作
  ☆61Updated 7 months ago
• wangyuxinwhy / generate
  A Python Package to Access World-Class Generative Models
  ☆128Updated 11 months ago
• CyberCommy / baidu-qa-100w
  百度QA100万数据集
  ☆47Updated last year
• pluto-junzeng / C4-zh
  大规模中文语料
  ☆42Updated 5 years ago
• aplmikex / deduplication_mnbvc
  文本去重
  ☆72Updated last year
• jayhenry / pdf2txt_mnbvc
  ☆41Updated last year
• ssbuild / t5_finetuning
  clue chatyuan finetuning
  ☆17Updated 2 months ago
• laughing429 / textRewriting
  中文文本改写
  ☆19Updated 4 years ago
• lutongyv / Textin_Tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆22Updated 10 months ago
• silverriver / ChatGLM-6B-Slim
  ChatGLM-6B-Slim：裁减掉20K图片Token的ChatGLM-6B，完全一样的性能，占用更小的显存。
  ☆126Updated 2 years ago
• Jacob-Zhou / simple-csc
  This repository provides an implementation of the paper "A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Co…
  ☆69Updated 2 months ago
• zejunwang1 / darmatch
  一个非常高效的字符串匹配工具，支持正向/反向最大匹配分词和多模式字符串精确匹配
  ☆17Updated last year
• shuyhere / all-about-llm
  大语言模型训练和服务调研
  ☆37Updated last year
• ssbuild / moss_finetuning
  moss chat finetuning
  ☆50Updated last year
• shibing624 / AIDailyNews
  auto push daily news with ai
  ☆13Updated this week
• xueyouluo / speller-bert
  中文纠错
  ☆92Updated 3 years ago
• yujunhuics / timeparser
  时间抽取、解析、标准化工具
  ☆52Updated 2 years ago
• yidun / antispam-python-demo
  易盾反垃圾python演示
  ☆29Updated 10 months ago
• tianchiguaixia / medical_records_extract
  该项目主要是抽取病历文件中的一些关键信息。并将抽取的内容进行streamlit前端的展示。目前支持的文件类型：图片，pdf文件，word文件
  ☆23Updated 2 years ago
• shibing624 / SearchGPT
  SearchGPT: Building a quick conversation-based search engine with LLMs.
  ☆46Updated 5 months ago
• dongrixinyu / jiojio
  A convenient Chinese word segmentation tool 简便中文分词器
  ☆46Updated 3 weeks ago
• OKC13 / General-Documents-Layout-parser
  通用版面分析 | 中文文档解析 |Document Layout Analysis | layout paser
  ☆46Updated 11 months ago
• shibing624 / relext
  RelExt: A Tool for Relation Extraction from Text. 文本实体关系抽取工具。
  ☆50Updated 2 years ago
• shibing624 / lmft
  ChatGLM-6B fine-tuning.
  ☆135Updated 2 years ago
• cnyangkui / html-extractor
  基于行块分布函数的通用网页正文抽取算法优化，Python实现
  ☆60Updated 5 years ago
• zhangnn520 / znn_chatglm
  打造人人都会的NLP，开源不易，记得star哦
  ☆101Updated 2 years ago
• taishan1994 / Qwen2-UIE
  基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】
  ☆31Updated 10 months ago
• qianzhengyang / AllDataPackages
  中文、分词、词表、核心词典、事件词表、停用词、敏感词、问答、问答数据、知识图谱、文本语料。
  ☆164Updated 3 years ago
• CyberCommy / baidu-wiki-500w
  百度百科 500 万数据集
  ☆35Updated last year