shibing624 / pinyin-tokenizerLinks
pinyintokenizer, 拼音分词器,将连续的拼音切分为单字拼音列表。
☆30Updated 7 months ago
Alternatives and similar repositories for pinyin-tokenizer
Users that are interested in pinyin-tokenizer are comparing it to the libraries listed below
Sorting:
- 一个微博毒舌AI,疯狂 diss 微博博主☆12Updated 8 months ago
- 利用LLM+敏感词库,来自动判别是否涉及敏感词。☆129Updated 2 years ago
- ChatGLM-6B-Slim:裁减掉20K图片Token的ChatGLM-6B,完全一样的性能,占用更小的显存。☆127Updated 2 years ago
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆49Updated last week
- This repository provides an implementation of "A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction B…☆78Updated 2 months ago
- A Multi-Modal Dataset of Chinese Governmental Docunments☆35Updated 4 years ago
- A Python Package to Access World-Class Generative Models☆129Updated last year
- 首个llama2 13b 中文版模型 (Base + 中文对话SFT,实现流畅多轮人机自然语言交互)☆91Updated 2 years ago
- share data, prompt data , pretraining data☆36Updated last year
- A large high-quality corpus of Chinese synonyms 一个大型、高质量的中文同义词语料库。☆62Updated 3 years ago
- Python3 package for Chinese/English OCR,use paddleocr-v5 onnx model(~20MB), with ultra-fast inference speed. 基于ppocr-v5-onnx模型推理,中英文OCR开源…☆105Updated 2 months ago
- The code and data for GrammarGPT.☆176Updated last year
- 百度QA100万数据集☆48Updated last year
- GTS Engine: A powerful NLU Training System。GTS引擎(GTS-Engine)是一款开箱即用且性能强大的自然语言理解引擎,聚焦于小样本任务,能够仅用小样本就能自动化生产NLP模型。☆92Updated 2 years ago
- 中文、分词、词表、核心词典、事件词表、停用词、敏感词、问答、问答数据、知识图谱、文本语料。☆170Updated 3 years ago
- Chinese Couplets Dataset without vulgar words. 不包含敏感内容的对联数据集。☆77Updated 5 years ago
- SearchGPT: Building a quick conversation-based search engine with LLMs.☆47Updated 8 months ago
- Code & Data for our Paper "NaSGEC: Multi-Domain Chinese Grammatical Error Correction for Native Speaker Texts" (ACL 2023 Findings)☆93Updated 7 months ago
- 大规模中文语料☆44Updated 5 years ago
- clue chatyuan finetuning☆17Updated 6 months ago
- Silk Road will be the dataset zoo for Luotuo(骆驼). Luotuo is an open sourced Chinese-LLM project founded by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子…☆40Updated last year
- chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu☆164Updated 2 years ago
- 一个基于预训练的句向量生成工具☆138Updated 2 years ago
- auto push daily news with ai☆14Updated last week
- 中文纠错☆93Updated 3 years ago
- 时间抽取、解析、标准化工具☆55Updated 2 years ago
- moss chat finetuning☆51Updated last year
- SuperCLUE琅琊榜:中文通用大模型匿名对战评价基准☆145Updated last year
- 基于sentence transformers和chatglm实现的文档搜索工具☆157Updated 2 years ago
- Evaluation for AI apps and agent☆43Updated last year