dablelv / dirty-cnwords
收录常见业务安全场景中文脏词,如广告引流、辱骂、暴恐、黄赌毒政类。
☆56Updated last year
Related projects ⓘ
Alternatives and complementary repositories for dirty-cnwords
- bert语言模型校验句子的通顺性☆15Updated 4 years ago
- 百度百科 500 万数据集☆30Updated 11 months ago
- 手动实现Elasticsearch的倒排索引以及BM25算法☆45Updated 5 years ago
- Correcting Chinese Spelling Errors with Phonetic Pre-training 非官方实现☆38Updated 2 years ago
- 时间抽取、解析、标准化工具☆49Updated 2 years ago
- 基于mlm方式的带有纠错功能的拼音转汉字bert预训练模型,pinyin correcter,基于pytorch框架实现☆45Updated 4 years ago
- python | 高效使用统计语言模型kenlm:新词发现、分词、智能纠错等☆163Updated 5 years ago
- 通用版面分析 | 中文文档解析 |Document Layout Analysis | layout paser☆45Updated 5 months ago
- 基于seq2edit (Gector) 的中文文本纠错。☆26Updated 2 years ago
- ChatGLM-6B fine-tuning.☆135Updated last year
- 高性能文本 Tokenizer 库☆27Updated 9 months ago
- text security audit 安全审核-语义模型过滤 敏感内容检测系统☆12Updated 4 months ago
- 文本相似度,语义向量,文本向量,text-similarity,similarity, sentence-similarity,BERT,SimCSE,BERT-Whitening,Sentence-BERT, PromCSE, SBERT☆69Updated 7 months ago
- 基于sentence-transformers实现文本转向量的机器人☆45Updated 2 years ago
- ☆18Updated 3 years ago
- ☆65Updated 10 months ago
- llama inference for tencentpretrain☆96Updated last year
- 中文标点符号模型,可以给文本添加标点符号。☆130Updated 9 months ago
- 任务型对话系统(Task-based Dialogue System)☆65Updated 2 years ago
- 一套代码指令微调大模型☆37Updated last year
- 专注于中文领域大语言模型,落地到某个行业某个领域,成为一个行业大模型、公司级别或行业级别领域大模型。☆112Updated 2 months ago
- Code & Data for our Paper "NaSGEC: Multi-Domain Chinese Grammatical Error Correction for Native Speaker Texts" (ACL 2023 Findings)☆76Updated last year
- ☆26Updated last year
- 基于Pytorch的文本分类框架,支持TextCNN、Bert、Electra等。☆58Updated last year
- ChatGLM2-6B微调, SFT/LoRA, instruction finetune☆106Updated last year
- ☆52Updated 9 months ago
- deep training task☆29Updated last year
- 中文文本纠错模型,keras实现☆70Updated 3 years ago
- 中文文本纠错相关的论文、比赛和工具。☆49Updated 4 months ago
- 文本智能校对大赛(Chinese Text Correction)的baseline☆64Updated 2 years ago