数据清洗，文本审核。DataFine mainly includes a number of data processing methods including rule cleaning, sensitive word filtering, advertisement filtering, de-duplication and sensitive content functions, providing safe and reliable data for the training of Chinese corpus.
☆12Feb 14, 2025Updated last year
Alternatives and similar repositories for DataFine
Users that are interested in DataFine are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- text security audit 安全审核-语义模型过滤 敏感内容检测系统☆40Feb 14, 2025Updated last year
- 利用分类法和敏感词检测法对生成式大模型的输入和输出内容进行安全检测，尽早识别风险内容。The input and output contents of generative large model are checked by classification method a…☆28Sep 9, 2024Updated 2 years ago
- 这里将paddle中的ocr等模型转为onnx格式，并利用java版深度框架djl加载这些onnx模型进行推理预测尝试。☆14Nov 15, 2022Updated 3 years ago
- textcnn for advertising detection，广告检测☆11Jan 12, 2024Updated 2 years ago
- 深度网络实现意图分类。☆11Feb 26, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A Claude Code skill that turns Claude into an infinite development loop: spec → feature list → implement → test → commit → repeat — acros…☆13Mar 11, 2026Updated 7 months ago
- model2onnx，将roberta和macbert模型转为onnx格式，并进行推理。☆19Jul 13, 2022Updated 4 years ago
- MacBERT for Chinese Spelling Correction, macbert中文拼写纠错☆16May 23, 2022Updated 4 years ago
- Title and keywords are used to generate text.☆12Dec 6, 2021Updated 4 years ago
- 利用java对文章进行分析并图谱化展示（主要提取关键词、实体、依存分析等）。☆12Apr 14, 2023Updated 3 years ago
- 智能医疗诊断助手，Intelligent Medical Diagnosis Assistant☆20Nov 6, 2025Updated last year
- 中文对话数据清洗☆31Nov 8, 2022Updated 4 years ago
- ocr，pdf转docx，pdf to docx☆21Nov 4, 2022Updated 4 years ago
- 利用sklearn和gensim中的tfidf,lsa,doc2vec进行查询与文档匹配搜索☆21Sep 11, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 智能文本自动处理工具（Intelligent text automatic processing tool）。AutoText的功能主要有文本纠错，图片ocr、版面检测以及表格结构识别等。The main functions of this project include …☆28May 17, 2023Updated 3 years ago
- 大模型预训练中文语料清洗及质量评估 Large model pre-training corpus cleaning☆80Jul 25, 2024Updated 2 years ago
- albert-fc for LP(Link Prediction)，中文实体链接预测☆20Apr 21, 2023Updated 3 years ago
- Azin's Dev Tool Kit☆10Mar 26, 2026Updated 7 months ago
- 题目知识点预测标注。Question knowledge point prediction.☆23Sep 11, 2022Updated 4 years ago
- pdf multimodal rag 【pdf多模态rag问答】☆30Feb 26, 2025Updated last year
- ☆11Jul 20, 2025Updated last year
- "AI-Trader: Can AI Beat the Market?" Live Trading: https://hkuds.github.io/AI-Trader/☆13Nov 5, 2025Updated last year
- AI 应用开发从入门到精通☆15Jun 21, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- youtube视频n内容总结skill☆10Feb 9, 2026Updated 9 months ago
- dsh-plugin-developer — DeepSeek Harness 插件开发 Skill > 指导 AI Agent 从 0 到 1 开发、构建、安装、测试 DeepSeek Harness（dsh）插件。基于 **dsh 0.1.1-rc.2** 与 dsh…☆43Updated this week
- pdf目录生成☆12Jan 19, 2026Updated 9 months ago
- 张小峰：一站式AI高考志愿填报助手☆14Jun 2, 2026Updated 5 months ago
- 本项目利用JNI加载paddle-ocr的C++编译的dll库，并利用springboot进行web部署访问。This project uses JNI to load the C++ compiled dll libraries of paddle-ocr, and us…☆37Dec 30, 2024Updated last year
- reveal xored strings in mirai binary☆12Oct 24, 2018Updated 8 years ago
- AI generates interactive knowledge quizzes with instant feedback and one-click Notebook export☆16Nov 2, 2026Updated last week
- ☆10Aug 23, 2026Updated 2 months ago
- 为你的赛博招魂幡 Skill 提供一个赛博酒吧🍺☆14Apr 13, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 一个文字游戏网站，用户可以制作并发布文字冒险游戏，多结局/货币系统/随机事件☆12Sep 12, 2020Updated 6 years ago
- ☆13Oct 10, 2026Updated last month
- ☆13Jan 10, 2024Updated 2 years ago
- Dirfuzz by golang☆14Feb 28, 2023Updated 3 years ago
- Use AI to Write Novels☆10Apr 14, 2025Updated last year
- odoo10绿色版，64位，优化各种参数☆10Dec 30, 2024Updated last year
- 华容道，一种单人拼图类游戏☆10Feb 12, 2019Updated 7 years ago
Are these results useful?