dablelv / dirty-cnwordsLinks
收录常见业务安全场景中文脏词,如广告引流、辱骂、暴恐、黄赌毒政类。
☆59Updated 2 years ago
Alternatives and similar repositories for dirty-cnwords
Users that are interested in dirty-cnwords are comparing it to the libraries listed below
Sorting:
- 中文谐音词/字库(同音词/字)Chinese Homophones☆106Updated 5 years ago
- Code & Data for our Paper "NaSGEC: Multi-Domain Chinese Grammatical Error Correction for Native Speaker Texts" (ACL 2023 Findings)☆89Updated 4 months ago
- text security audit 安全审核-语义模型过滤 敏感内容检测系统☆25Updated 4 months ago
- DFA 实现中文敏感词检测☆101Updated 3 years ago
- 一个短视频app文本审核模块的实现思路及demo☆120Updated 6 years ago
- 评估自然语言的流畅度☆116Updated 3 years ago
- Self complemented Pinyin2Chinese demo use algorithms including Trie and HMM model , 基于隐马尔科夫模型与Trie树的拼音切分与拼音转中文的简单demo实现。☆86Updated 7 years ago
- 百度百科 500 万数据集☆37Updated last year
- 中文纠错☆92Updated 3 years ago
- 暴恐违禁 文本色情 政治敏感 恶意推广 低俗辱骂☆98Updated 3 years ago
- 本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作☆61Updated 8 months ago
- 时间抽取、解析、标准化工具☆52Updated 2 years ago
- 基于mlm方式的带有纠错功能的拼音转汉字bert预训练模型,pinyin correcter,基于pytorch框架实现☆45Updated 4 years ago
- 基于simhash的文本去重算法☆20Updated 4 years ago
- ☆81Updated last year
- 本项目旨在识别长短文本中的敏感词,并对整段/句文本进行语义分类,从而达到文本审核的目的☆64Updated 5 years ago
- Correcting Chinese Spelling Errors with Phonetic Pre-training 非官方实现☆40Updated 3 years ago
- 利用LLM+敏感词库,来自动判别是否涉及敏感词。☆124Updated last year
- python | 高效使用统计语言模型kenlm:新词发现、分词、智能纠错等☆164Updated 5 years ago
- baichuan and baichuan2 finetuning and alpaca finetuning☆32Updated 3 months ago
- NER实体识别模型,快速高效简单一键部署docker部署调用模型。能识别:地址、人名、机构名实体。☆36Updated last year
- 图片向量检索服务,包含Numpy、Faiss、ES、Milvus多种计算引擎☆136Updated 2 years ago
- QBQTC: 大规模搜索匹配数据集☆82Updated 3 years ago
- ChatGLM-6B fine-tuning.☆135Updated 2 years ago
- 大规模中文语料☆42Updated 5 years ago
- code and data for "CSCD-NS: a Chinese Spelling Check Dataset for Native Speakers"☆69Updated 10 months ago
- llama inference for tencentpretrain☆98Updated 2 years ago
- CCL 2022 汉语学习者文本纠错评测☆141Updated 2 years ago
- 专注于中文领域大语言模型,落地到某个行业某个领域,成为一个行业大模型、公司级别或行业级别领域大模型。☆118Updated 3 months ago
- Chinese MobileBERT(中文MobileBERT模型)☆93Updated 3 years ago