Alternatives and similar repositories for pinyin-tokenizer:

Users that are interested in pinyin-tokenizer are comparing it to the libraries listed below

• shibing624 / imgocr
  Python3 package for Chinese/English OCR, with paddleocr-v4 onnx model(~14MB). 基于ppocr-v4-onnx模型推理，可实现 CPU 上毫秒级的 OCR 精准预测，通用场景中英文OCR达到开源SO…
  ☆52Updated 3 weeks ago
• shibing624 / github-hot
  Tracking the hot Github repos and update daily 每天自动追踪Github热门项目
  ☆44Updated this week
• IDEA-CCNL / GTS-Engine
  GTS Engine: A powerful NLU Training System。GTS引擎（GTS-Engine）是一款开箱即用且性能强大的自然语言理解引擎，聚焦于小样本任务，能够仅用小样本就能自动化生产NLP模型。
  ☆91Updated last year
• zhangnn520 / znn_chatglm
  打造人人都会的NLP，开源不易，记得star哦
  ☆101Updated last year
• shibing624 / weibo-roast
  一个微博毒舌AI，疯狂 diss 微博博主
  ☆11Updated 2 weeks ago
• tianchiguaixia / medical_records_extract
  该项目主要是抽取病历文件中的一些关键信息。并将抽取的内容进行streamlit前端的展示。目前支持的文件类型：图片，pdf文件，word文件
  ☆23Updated 2 years ago
• pleisto / yuren-13b
  Yuren 13B is an information synthesis large language model that has been continuously trained based on Llama 2 13B, which builds upon the…
  ☆14Updated last year
• lutongyv / Textin_Tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆23Updated 6 months ago
• flyme2023 / bge
  bge推理优化相关脚本
  ☆25Updated 11 months ago
• OKC13 / General-Documents-Layout-parser
  通用版面分析 | 中文文档解析 |Document Layout Analysis | layout paser
  ☆45Updated 7 months ago
• yujunhuics / timeparser
  时间抽取、解析、标准化工具
  ☆50Updated 2 years ago
• CyberCommy / baidu-qa-100w
  百度QA100万数据集
  ☆47Updated last year
• silverriver / ChatGLM-6B-Slim
  ChatGLM-6B-Slim：裁减掉20K图片Token的ChatGLM-6B，完全一样的性能，占用更小的显存。
  ☆126Updated last year
• ssbuild / t5_finetuning
  clue chatyuan finetuning
  ☆17Updated 8 months ago
• shuyhere / all-about-llm
  大语言模型训练和服务调研
  ☆35Updated last year
• wellinxu / LLM_Custome
  在中文开源大模型的基础上进行定制化的微调，拥有自己专属的语言模型。
  ☆46Updated last year
• LC1332 / Luotuo-QA
  骆驼QA，中文大语言阅读理解模型。
  ☆74Updated last year
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆36Updated last year
• shibing624 / agentica
  Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。
  ☆115Updated 2 weeks ago
• CyberCommy / baidu-wiki-500w
  百度百科 500 万数据集
  ☆32Updated last year
• ssbuild / moss_finetuning
  moss chat finetuning
  ☆50Updated 8 months ago
• CodingMonkey12 / Semantic-Search-using-Paddle
  基于Paddle进行语义检索并部署上线，支持多语言 This code is based on Paddle to do a semantic search, and deploy it. Multilingual support
  ☆11Updated 2 years ago
• mobvoi / seq-monkey-data
  ☆109Updated 7 months ago
• shibing624 / SearchGPT
  SearchGPT: Building a quick conversation-based search engine with LLMs.
  ☆43Updated 2 weeks ago
• zejunwang1 / bert4vec
  一个基于预训练的句向量生成工具
  ☆134Updated last year
• wptoux / self-instruct-zh
  基于ChatGPT构建的中文self-instruct数据集
  ☆113Updated last year
• zejunwang1 / chatglm_tuning
  基于 LoRA 和 P-Tuning v2 的 ChatGLM-6B 高效参数微调
  ☆54Updated last year
• kaixindelele / ChatSensitiveWords
  利用LLM+敏感词库，来自动判别是否涉及敏感词。
  ☆109Updated last year
• shibing624 / relext
  RelExt: A Tool for Relation Extraction from Text. 文本实体关系抽取工具。
  ☆48Updated 2 years ago