大模型预训练中文语料清洗及质量评估 Large model pre-training corpus cleaning
☆80Jul 25, 2024Updated 2 years ago
Alternatives and similar repositories for llm_corpus_quality
Users that are interested in llm_corpus_quality are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- textcnn for advertising detection，广告检测☆11Jan 12, 2024Updated 2 years ago
- text security audit 安全审核-语义模型过滤 敏感内容检测系统☆40Feb 14, 2025Updated last year
- 这里将paddle中的ocr等模型转为onnx格式，并利用java版深度框架djl加载这些onnx模型进行推理预测尝试。☆14Nov 15, 2022Updated 3 years ago
- 数据清洗，文本审核。DataFine mainly includes a number of data processing methods including rule cleaning, sensitive word filtering, advertisement f…☆12Feb 14, 2025Updated last year
- 利用分类法和敏感词检测法对生成式大模型的输入和输出内容进行安全检测，尽早识别风险内容。The input and output contents of generative large model are checked by classification method a…☆28Sep 9, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 智能文本自动处理工具（Intelligent text automatic processing tool）。AutoText的功能主要有文本纠错，图片ocr、版面检测以及表格结构识别等。The main functions of this project include …☆28May 17, 2023Updated 3 years ago
- 专注于中文领域大语言模型，落地到某个行业某个领域，成为一个行业大模型、公司级别或行业级别领域大模型。☆126May 19, 2026Updated 5 months ago
- 利用java-yolov8实现版面检测（Chinese layout detection），java-yolov8 is used to detect the layout of Chinese document images☆27May 5, 2023Updated 3 years ago
- A comprehensive toolkit for streamlining data editing, search, and inspection for large-scale language model training and interpretabilit…☆21Oct 30, 2025Updated last year
- 面向中国工业环境的预测性维护 AI 框架。Open-Source AI Framework for Industrial Predictive Maintenance☆15Sep 11, 2026Updated last month
- TABLE DETECTION IN IMAGES AND OCR TO CSV WITH JAVA☆10Jul 18, 2023Updated 3 years ago
- ☆366Jun 13, 2024Updated 2 years ago
- Here is a demo for PDF parser (Including OCR, object detection tools)☆36Oct 14, 2024Updated 2 years ago
- t5-model-onnx，中文拼写纠错，Chinese spelling correction。☆15Sep 18, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 深度网络实现意图分类。☆11Feb 26, 2021Updated 5 years ago
- 中文医疗NLP领域 数据集，论文 ，知识图谱，语料，工具包☆16Oct 15, 2020Updated 6 years ago
- Through RL training, stimulate the reflective capabilities of the prover model.☆12Apr 17, 2025Updated last year
- MacBERT for Chinese Spelling Correction, macbert中文拼写纠错☆16May 23, 2022Updated 4 years ago
- spark tutorial for big data mining。包括app流量运营分析、als推荐、smote样本采样、RFM客户价值分群、AHP层次分析客户价值得分、手机定位数据商圈挖掘、马尔可夫智能邮件预测、时序预测、关联规则、推荐电影好友等。☆40Sep 10, 2022Updated 4 years ago
- 利用llm大语言模型提取卡证票据关键信息。Key Information Extraction from Image with LLM(large language model).Basically, it can extract key information from …☆15Jul 22, 2024Updated 2 years ago
- Title and keywords are used to generate text.☆12Dec 6, 2021Updated 4 years ago
- near-synonym, 基于大模型LLM的中文反义词/近义词(antonyms/synonyms)工具包. 也可计算词语相似度/句子相似度/文本相似度等。☆31Apr 29, 2025Updated last year
- The code for our ACL2022 findings paper: CRACSpell: A Contextual Typo Robust Approach with Copy Mechanism to Improve Chinese Spelling Cor…☆77May 16, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Um site dinâmico desenvolvido em Next.js, utilizando tecnologias como Tailwind CSS e diversas bibliotecas de UI do Radix UI e Shadcn UI. …☆20Sep 24, 2024Updated 2 years ago
- 本项目利用JNI加载paddle-ocr的C++编译的dll库，并利用springboot进行web部署访问。This project uses JNI to load the C++ compiled dll libraries of paddle-ocr, and us…☆37Dec 30, 2024Updated last year
- The GPU RAM Estimator provides a simple tool for estimating GPU memory usage during training and inference.☆34Apr 9, 2024Updated 2 years ago
- Python Scritpt which can be embedded into PyTorch model to print the model size.☆19Apr 19, 2021Updated 5 years ago
- Spring Deep Java Library 通过利用DJL框架与其他Spring框架进行整合，进行深度学习模型训练和推导。☆24Mar 16, 2022Updated 4 years ago
- intent detection and slot filling 意图识别与槽填充联合模型☆44Sep 11, 2022Updated 4 years ago
- 一个基于 模型上下文协议/MCP 构建的智能医学文献分析工具。它旨在帮助科研人员、医学从业者和学生快速检索 PubMed 数据库，并利用大型语言模型 (LLM) 的能力对文献摘要进行智能分析和总结☆11Jun 17, 2026Updated 4 months ago
- 利用java对文章进行分析并图谱化展示（主要提取关键词、实体、依存分析等）。☆12Apr 14, 2023Updated 3 years ago
- Heuristic filtering framework for RefineCode☆90Mar 13, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆11Dec 12, 2023Updated 2 years ago
- Code & Data for our Paper "NaSGEC: Multi-Domain Chinese Grammatical Error Correction for Native Speaker Texts" (ACL 2023 Findings)☆97Feb 18, 2025Updated last year
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆80Nov 14, 2024Updated last year
- Turn your Hermes agent into a financial analyst — on-demand equities / macro / options / prediction-market analysis, plus a standing watc…☆26Jul 22, 2026Updated 3 months ago
- ☆22Dec 8, 2022Updated 3 years ago
- Claude Skill for Patent Filing Quality Control☆12Jul 23, 2026Updated 3 months ago
- 本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作☆71Sep 11, 2026Updated last month