Alternatives and similar repositories for pinyin-tokenizer

Users that are interested in pinyin-tokenizer are comparing it to the libraries listed below

• shibing624 / weibo-roast
  一个微博毒舌AI，疯狂 diss 微博博主
  ☆15Updated last year
• Jacob-Zhou / simple-csc
  This repository provides an implementation of "A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction B…
  ☆85Updated 6 months ago
• kaixindelele / ChatSensitiveWords
  利用LLM+敏感词库，来自动判别是否涉及敏感词。
  ☆137Updated 2 years ago
• wangyuxinwhy / generate
  A Python Package to Access World-Class Generative Models
  ☆131Updated last year
• v-zich / couplet-clean-dataset
  Chinese Couplets Dataset without vulgar words. 不包含敏感内容的对联数据集。
  ☆77Updated 6 years ago
• shuyhere / all-about-llm
  大语言模型训练和服务调研
  ☆37Updated 2 years ago
• zejunwang1 / bert4vec
  一个基于预训练的句向量生成工具
  ☆138Updated 2 years ago
• CyberCommy / baidu-qa-100w
  百度QA100万数据集
  ☆46Updated 2 years ago
• shibing624 / imgocr
  Python3 package for Chinese/English OCR,use paddleocr-v5 onnx model(~20MB), with ultra-fast inference speed. 基于ppocr-v5-onnx模型推理，中英文OCR开源…
  ☆125Updated this week
• shibing624 / github-hot
  Tracking the hot Github repos and update daily 每天自动追踪Github热门项目
  ☆50Updated this week
• jaaack-wang / Chinese-Synonyms
  A large high-quality corpus of Chinese synonyms 一个大型、高质量的中文同义词语料库。
  ☆69Updated 4 years ago
• silverriver / ChatGLM-6B-Slim
  ChatGLM-6B-Slim：裁减掉20K图片Token的ChatGLM-6B，完全一样的性能，占用更小的显存。
  ☆126Updated 2 years ago
• xverse-ai / XVERSE-7B
  XVERSE-7B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆53Updated last year
• HillZhang1999 / NaSGEC
  Code & Data for our Paper "NaSGEC: Multi-Domain Chinese Grammatical Error Correction for Native Speaker Texts" (ACL 2023 Findings)
  ☆96Updated 11 months ago
• CrazyBoyM / llama2-Chinese-chat
  首个llama2 13b 中文版模型 （Base + 中文对话SFT，实现流畅多轮人机自然语言交互)
  ☆91Updated 2 years ago
• IDEA-CCNL / GTS-Engine
  GTS Engine: A powerful NLU Training System。GTS引擎（GTS-Engine）是一款开箱即用且性能强大的自然语言理解引擎，聚焦于小样本任务，能够仅用小样本就能自动化生产NLP模型。
  ☆93Updated 2 years ago
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆44Updated 2 years ago
• LC1332 / Luotuo-Silk-Road
  Silk Road will be the dataset zoo for Luotuo(骆驼). Luotuo is an open sourced Chinese-LLM project founded by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子…
  ☆40Updated 2 years ago
• xueyouluo / speller-bert
  中文纠错
  ☆91Updated 3 years ago
• zhangnn520 / znn_chatglm
  打造人人都会的NLP，开源不易，记得star哦
  ☆102Updated 2 years ago
• lutongyv / Textin_Tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆22Updated last year
• shibing624 / AIDailyNews
  auto push daily news with ai
  ☆13Updated this week
• ProjectD-AI / llama_inference
  llama inference for tencentpretrain
  ☆99Updated 2 years ago
• taishan1994 / Qwen2-UIE
  基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】
  ☆40Updated last year
• yongzhuo / chatglm-maths
  chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu
  ☆165Updated 2 years ago
• blcuicall / taoli
  "桃李“: 国际中文教育大模型
  ☆189Updated 2 years ago
• OKC13 / General-Documents-Layout-parser
  通用版面分析 | 中文文档解析 |Document Layout Analysis | layout paser
  ☆48Updated last year
• zejunwang1 / chatglm_tuning
  基于 LoRA 和 P-Tuning v2 的 ChatGLM-6B 高效参数微调
  ☆55Updated 2 years ago
• Claude-Liu / ReLM
  Rephrasing Language Model for CSC (AAAI 2024)
  ☆44Updated last year
• CLUEbenchmark / SuperCLUElyb
  SuperCLUE琅琊榜：中文通用大模型匿名对战评价基准
  ☆145Updated last year