shibing624 / pinyin-tokenizerLinks
pinyintokenizer, 拼音分词器，将连续的拼音切分为单字拼音列表。
☆30Updated 6 months ago
Alternatives and similar repositories for pinyin-tokenizer
Users that are interested in pinyin-tokenizer are comparing it to the libraries listed below
Sorting:
- ChatGLM-6B-Slim：裁减掉20K图片Token的ChatGLM-6B，完全一样的性能，占用更小的显存。☆127Updated 2 years ago
- 一个微博毒舌AI，疯狂 diss 微博博主☆12Updated 8 months ago
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆49Updated this week
- 百度QA100万数据集☆48Updated last year
- A Python Package to Access World-Class Generative Models☆129Updated last year
- 利用LLM+敏感词库，来自动判别是否涉及敏感词。☆127Updated 2 years ago
- 基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】☆35Updated last year
- 通用版面分析 | 中文文档解析 |Document Layout Analysis | layout paser☆47Updated last year
- This repository provides an implementation of "A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction B…☆75Updated last month
- 打造人人都会的NLP，开源不易，记得star哦☆101Updated 2 years ago
- Python3 package for Chinese/English OCR,use paddleocr-v5 onnx model(~20MB), with ultra-fast inference speed. 基于ppocr-v5-onnx模型推理，中英文OCR开源…☆100Updated last month
- SearchGPT: Building a quick conversation-based search engine with LLMs.☆47Updated 7 months ago
- 中文、分词、词表、核心词典、事件词表、停用词、敏感词、问答、问答数据、知识图谱、文本语料。☆169Updated 3 years ago
- 首个llama2 13b 中文版模型 （Base + 中文对话SFT，实现流畅多轮人机自然语言交互)☆91Updated 2 years ago
- 基于 LoRA 和 P-Tuning v2 的 ChatGLM-6B 高效参数微调☆55Updated 2 years ago
- Another ChatGLM2 implementation for GPTQ quantization☆55Updated last year
- 实现一种多Lora权值集成切换+Zero-Finetune零微调增强的跨模型技术方案，LLM-Base+LLM-X+Alpaca，初期，LLM-Base为Chatglm6B底座模型，LLM-X是LLAMA增强模型。该方案简易高效，目标是使此类语言模型能够低能耗广泛部署，并最…☆117Updated 2 years ago
- 骆驼QA，中文大语言阅读理解模型。☆75Updated 2 years ago
- chatglm-6b微调/LORA/PPO/推理, 样本为自动生成的整数/小数加减乘除运算, 可gpu/cpu☆164Updated 2 years ago
- The code and data for GrammarGPT.☆178Updated last year
- llama inference for tencentpretrain☆99Updated 2 years ago
- Silk Road will be the dataset zoo for Luotuo(骆驼). Luotuo is an open sourced Chinese-LLM project founded by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子…☆40Updated last year
- GTS Engine: A powerful NLU Training System。GTS引擎（GTS-Engine）是一款开箱即用且性能强大的自然语言理解引擎，聚焦于小样本任务，能够仅用小样本就能自动化生产NLP模型。☆91Updated 2 years ago
- Llama2开源模型中文版-全方位测评，基于SuperCLUE的OPEN基准 | Llama2 Chinese evaluation with SuperCLUE☆127Updated 2 years ago
- CamelBell（驼铃) is be a Chinese Language Tuning project based on LoRA. CamelBell is belongs to Project Luotuo(骆驼), an open sourced Chinese-…☆172Updated last year
- 中文纠错☆93Updated 3 years ago
- 一个基于预训练的句向量生成工具☆138Updated 2 years ago
- 基于sentence transformers和chatglm实现的文档搜索工具☆157Updated 2 years ago
- 渊 - A project for Classical Chinese☆106Updated 3 years ago
- 🌈 NERpy: Implementation of Named Entity Recognition using Python. 命名实体识别工具，支持BertSoftmax、BertSpan等模型，开箱即用。☆115Updated last year