shibing624 / pinyin-tokenizerLinks
pinyintokenizer, 拼音分词器，将连续的拼音切分为单字拼音列表。
☆30Updated 4 months ago
Alternatives and similar repositories for pinyin-tokenizer
Users that are interested in pinyin-tokenizer are comparing it to the libraries listed below
Sorting:
- Silk Road will be the dataset zoo for Luotuo(骆驼). Luotuo is an open sourced Chinese-LLM project founded by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子…☆39Updated last year
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆49Updated this week
- 一个基于预训练的句向量生成工具☆137Updated 2 years ago
- 一个微博毒舌AI，疯狂 diss 微博博主☆12Updated 5 months ago
- 大语言模型训练和服务调研☆37Updated last year
- 本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作☆61Updated 8 months ago
- 时间抽取、解析、标准化工具☆52Updated 2 years ago
- ChatGLM-6B-Slim：裁减掉20K图片Token的ChatGLM-6B，完全一样的性能，占用更小的显存。☆126Updated 2 years ago
- 中文纠错☆92Updated 3 years ago
- auto push daily news with ai☆13Updated last week
- 如需体验textin文档解析，请点击https://cc.co/16YSIy☆22Updated 11 months ago
- Chinese Couplets Dataset without vulgar words. 不包含敏感内容的对联数据集。☆73Updated 5 years ago
- This repository provides an implementation of the paper "A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Co…☆70Updated 3 months ago
- A large high-quality corpus of Chinese synonyms 一个大型、高质量的中文同义词语料库。☆56Updated 3 years ago
- 骆驼QA，中文大语言阅读理解模型。☆74Updated 2 years ago
- 基于ChatGPT构建的中文self-instruct数据集☆118Updated 2 years ago
- Let ChatGPT (Large Language Models) Serve As Data Annotator and Zero-shot/few-shot Information Extractor.☆32Updated 2 years ago
- llama inference for tencentpretrain☆98Updated 2 years ago
- A Python Package to Access World-Class Generative Models☆127Updated last year
- 打造人人都会的NLP，开源不易，记得star哦☆101Updated 2 years ago
- 基于 LoRA 和 P-Tuning v2 的 ChatGLM-6B 高效参数微调☆55Updated 2 years ago
- 实现一种多Lora权值集成切换+Zero-Finetune零微调增强的跨模型技术方案，LLM-Base+LLM-X+Alpaca，初期，LLM-Base为Chatglm6B底座模型，LLM-X是LLAMA增强模型。该方案简易高效，目标是使此类语言模型能够低能耗广泛部署，并最…☆115Updated last year
- 利用LLM+敏感词库，来自动判别是否涉及敏感词。☆124Updated last year
- 百度QA100万数据集☆47Updated last year
- GTS Engine: A powerful NLU Training System。GTS引擎（GTS-Engine）是一款开箱即用且性能强大的自然语言理解引擎，聚焦于小样本任务，能够仅用小样本就能自动化生产NLP模型。☆91Updated 2 years ago
- clue chatyuan finetuning☆17Updated 3 months ago
- A convenient Chinese word segmentation tool 简便中文分词器☆46Updated last month
- Graph QABot Demo| 图谱问答案例☆15Updated 2 years ago
- RelExt: A Tool for Relation Extraction from Text. 文本实体关系抽取工具。☆50Updated 3 years ago
- Code & Data for our Paper "NaSGEC: Multi-Domain Chinese Grammatical Error Correction for Native Speaker Texts" (ACL 2023 Findings)☆89Updated 4 months ago