shibing624 / pinyin-tokenizerLinks
pinyintokenizer, 拼音分词器，将连续的拼音切分为单字拼音列表。
☆30Updated 5 months ago
Alternatives and similar repositories for pinyin-tokenizer
Users that are interested in pinyin-tokenizer are comparing it to the libraries listed below
Sorting:
- A Python Package to Access World-Class Generative Models☆127Updated last year
- 一个微博毒舌AI，疯狂 diss 微博博主☆12Updated 6 months ago
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆50Updated this week
- Python3 package for Chinese/English OCR, with paddleocr-v4 onnx model(~14MB). 基于ppocr-v4-onnx模型推理，可实现 CPU 上毫秒级的 OCR 精准预测，通用场景中英文OCR达到开源SO…☆90Updated 5 months ago
- 利用LLM+敏感词库，来自动判别是否涉及敏感词。☆126Updated 2 years ago
- SearchGPT: Building a quick conversation-based search engine with LLMs.☆46Updated 6 months ago
- ChatGLM-6B-Slim：裁减掉20K图片Token的ChatGLM-6B，完全一样的性能，占用更小的显存。☆126Updated 2 years ago
- 中文纠错☆92Updated 3 years ago
- This repository provides an implementation of "A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction B…☆71Updated last week
- GTS Engine: A powerful NLU Training System。GTS引擎（GTS-Engine）是一款开箱即用且性能强大的自然语言理解引擎，聚焦于小样本任务，能够仅用小样本就能自动化生产NLP模型。☆91Updated 2 years ago
- 百度QA100万数据集☆47Updated last year
- 首个llama2 13b 中文版模型 （Base + 中文对话SFT，实现流畅多轮人机自然语言交互)☆90Updated last year
- A convenient Chinese word segmentation tool 简便中文分词器☆46Updated 2 months ago
- auto push daily news with ai☆13Updated this week
- 大语言模型训练和服务调研☆37Updated last year
- Silk Road will be the dataset zoo for Luotuo(骆驼). Luotuo is an open sourced Chinese-LLM project founded by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子…☆39Updated last year
- 一个基于预训练的句向量生成工具☆137Updated 2 years ago
- 通用版面分析 | 中文文档解析 |Document Layout Analysis | layout paser☆46Updated last year
- 打造人人都会的NLP，开源不易，记得star哦☆101Updated 2 years ago
- Chinese Couplets Dataset without vulgar words. 不包含敏感内容的对联数据集。☆75Updated 5 years ago
- 中文、分词、词表、核心词典、事件词表、停用词、敏感词、问答、问答数据、知识图谱、文本语料。☆165Updated 3 years ago
- 基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】☆31Updated last year
- 基于 LoRA 和 P-Tuning v2 的 ChatGLM-6B 高效参数微调☆55Updated 2 years ago
- share data， prompt data , pretraining data☆36Updated last year
- Evaluation for AI apps and agent☆42Updated last year
- clue chatyuan finetuning☆16Updated 4 months ago
- Llama2开源模型中文版-全方位测评，基于SuperCLUE的OPEN基准 | Llama2 Chinese evaluation with SuperCLUE☆126Updated last year
- 如需体验textin文档解析，请点击https://cc.co/16YSIy☆22Updated last year
- The code and data for GrammarGPT.☆173Updated last year
- 百度百科 500 万数据集☆37Updated last year