dablelv / dirty-cnwords
收录常见业务安全场景中文脏词,如广告引流、辱骂、暴恐、黄赌毒政类。
☆58Updated 2 years ago
Alternatives and similar repositories for dirty-cnwords:
Users that are interested in dirty-cnwords are comparing it to the libraries listed below
- DFA 实现中文敏感词检测☆97Updated 2 years ago
- 中文 Instruction tuning datasets☆126Updated 10 months ago
- 评估自然语言的流畅度☆111Updated 3 years ago
- 中文纠错☆92Updated 2 years ago
- 暴恐违禁 文本色情 政治敏感 恶意推广 低俗辱骂☆95Updated 2 years ago
- ☆71Updated last year
- 本项目旨在识别长短文本中的敏感词,并对整段/句文本进行语义分类,从而达到文本审核的目的☆63Updated 5 years ago
- A framework for cleaning Chinese dialog data☆265Updated 3 years ago
- deep training task☆29Updated last year
- pke_zh, python keyphrase extraction for chinese(zh). 中文关键词或关键句提取工具,实现了KeyBert、PositionRank、TopicRank、TextRank等算法,开箱即用。☆197Updated 10 months ago
- 一个简单易用的 Python 模块,用于通过字 符串来操作日期/时间。正则时间提取,字符串时间解析,字符串时间提取。中文时间提取,一句话里面提取时间☆75Updated 7 months ago
- python | 高效使用统计语言模型kenlm:新词发现、分词、智能纠错等☆162Updated 5 years ago
- 专注于中文领域大语言模型,落地到某个行业某个领域,成为一个行业大模型、公司级别或行业级别领域大模型。☆115Updated 5 months ago
- text security audit 安全审核-语义模型过滤 敏感内容检测系统☆17Updated last week
- 继续预训练中文bert☆30Updated 3 years ago
- 一个基于预训练的句向量生成工具☆134Updated last year
- experiments of some semantic matching models and comparison of experimental results.☆161Updated last year
- Code & Data for our Paper "NaSGEC: Multi-Domain Chinese Grammatical Error Correction for Native Speaker Texts" (ACL 2023 Findings)☆83Updated this week
- 一个短视频app文本审核模块的实现思路及demo☆115Updated 6 years ago
- mirror of dongxiexidian/Chinese☆287Updated 6 years ago
- code and data for "CSCD-NS: a Chinese Spelling Check Dataset for Native Speakers"☆64Updated 6 months ago
- 中文心理问答数据集☆72Updated 4 years ago
- 中文、分词、词表、核心词典、事件词表、停用词、敏感词、问答、问答数据、知识图谱、文本语料。☆152Updated 3 years ago
- ChatGLM2-6B微调, SFT/LoRA, instruction finetune☆105Updated last year
- SinglepassTextCluster, an TextCluster tools based on Singlepass cluster algorithm that use tfidf vector and doc2vec,which can be used for…☆62Updated 3 years ago
- 百度百科 500 万数据集☆33Updated last year
- 李傲龍的博客☆81Updated 7 months ago
- 基于bert进行中文文本纠错☆228Updated last year
- baichuan LLM surpervised finetune by lora☆62Updated last year
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆234Updated 2 years ago